5. Data Analysis

Each data you send and all the related information (the way the data has been built, the feedback from the target, and so on) are stored within the fuddly database (an SQLite database located at ~/fuddly_data/fmkdb.db). They all get a unique ID, starting from 1 and increasing by 1 each time a data is sent.

To interact with the database a convenient toolkit is provided (<root of fuddly>/tools/fmkdb.py).

5.1. Usage Examples

Let’s say you want to look at all the information that have been recorded for one of the data you sent, with the ID 4. The following command will display a synthesis of what you want:

./tools/fmkdb.py -i 4

And if you want to get all information, issue the following:

./tools/fmkdb.py -i 4 --with-data --with-fbk

You can also request information on all data sent between two dates. For instance the following command will display all data information that have been recorded between 25th January 2016 (11:30) and 26th January 2016:

./tools/fmkdb.py --info-by-date 2016/01/25-11:30 2016/01/26

For further information refer to the help by issuing:

./tools/fmkdb.py -h

5.2. Fmkdb Toolkit Manual

Hereunder is shown the output of <root of fuddly>/tools/fmkdb.py -h.

usage: fmkdb.py [-h] [--fmkdb PATH] [--no-color] [-v] [--page-width WIDTH]
                [--fbk-src FEEDBACK_SOURCES] [--project PROJECT_NAME] [-s]
                [-i DATA_ID] [--info-by-date START END]
                [--info-by-ids FIRST_DATA_ID LAST_DATA_ID] [-wf] [-wd]
                [--without-fmkinfo] [--without-analysis] [--limit LIMIT]
                [--raw] [-dd] [-df] [--data-atom ATOM_NAME]
                [--fbk-atom ATOM_NAME] [--force-fbk-decoder DATA_MODEL_NAME]
                [--export-data FIRST_DATA_ID LAST_DATA_ID] [-e DATA_ID]
                [--remove-data FIRST_DATA_ID LAST_DATA_ID] [-r DATA_ID]
                [--data-with-impact] [--data-with-impact-raw]
                [--data-without-fbk]
                [--data-with-specific-fbk FEEDBACK_REGEXP] [-a IMPACT COMMENT]
                [--disprove-impact FIRST_ID LAST_ID]

Argument for FmkDB toolkit script

optional arguments:
  -h, --help            show this help message and exit

Miscellaneous Options:
  --fmkdb PATH          Path to an alternative fmkDB.db
  --no-color            Do not use colors
  -v, --verbose         Verbose mode
  --page-width WIDTH    Width hint for displaying information

Configuration Handles:
  --fbk-src FEEDBACK_SOURCES
                        Restrict the feedback sources to consider (through a
                        regexp). Supported by: --data-with-impact, --data-
                        without-fbk, --data-with-specific-fbk
  --project PROJECT_NAME
                        Restrict the data to be displayed to a specific
                        project. Supported by: --info-by-date, --info-by-ids,
                        --data-with-impact, --data-without-fbk, --data-with-
                        specific-fbk

Fuddly Database Visualization:
  -s, --all-stats       Show all statistics

Fuddly Database Information:
  -i DATA_ID, --data-id DATA_ID
                        Provide the data ID on which actions will be
                        performed. Without any other parameters the default
                        action is to display information on the specified data
                        ID.
  --info-by-date START END
                        Display information on data sent between START and END
                        (date format 'Year/Month/Day' or 'Year/Month/Day-Hour'
                        or 'Year/Month/Day-Hour:Minute')
  --info-by-ids FIRST_DATA_ID LAST_DATA_ID
                        Display information on all the data included within
                        the specified data ID range
  -wf, --with-fbk       Display full feedback (expect --data-id)
  -wd, --with-data      Display data content (expect --data-id)
  --without-fmkinfo     Do not display fmkinfo (expect --data-id)
  --without-analysis    Do not display user analysis (expect --data-id)
  --limit LIMIT         Limit the size of what is displayed from the sent data
                        and the retrieved feedback (expect --with-data or
                        --with-fbk).
  --raw                 Display data and feedback in raw format

Fuddly Decoding:
  -dd, --decode-data    Decode sent data based on the data model used for the
                        selected data ID or the atome name provided by --atom
  -df, --decode-fbk     Decode feedback based on the data model used for the
                        selected data ID or the atome name provided by --fbk-
                        atom
  --data-atom ATOM_NAME
                        Atom of the data model to be used for decoding the
                        sent data. If not provided, the name of the sent data
                        will be used.
  --fbk-atom ATOM_NAME  Atom of the data model to be used for decoding
                        feedback. If not provided, the default data model
                        decoder will be used (if one exists), or the name of
                        the first registered atom in the data model
  --force-fbk-decoder DATA_MODEL_NAME
                        Decode feedback with the decoder of the data model
                        specified

Fuddly Database Operations:
  --export-data FIRST_DATA_ID LAST_DATA_ID
                        Extract data from provided data ID range
  -e DATA_ID, --export-one-data DATA_ID
                        Extract data from the provided data ID
  --remove-data FIRST_DATA_ID LAST_DATA_ID
                        Remove data from provided data ID range and all
                        related information from fmkDB
  -r DATA_ID, --remove-one-data DATA_ID
                        Remove data ID and all related information from fmkDB

Fuddly Database Analysis:
  --data-with-impact    Retrieve data that negatively impacted a target.
                        Analysis is performed based on feedback status and
                        user analysis if present
  --data-with-impact-raw
                        Retrieve data that negatively impacted a target.
                        Analysis is performed based on feedback status
  --data-without-fbk    Retrieve data without feedback
  --data-with-specific-fbk FEEDBACK_REGEXP
                        Retrieve data with specific feedback provided as a
                        regexp
  -a IMPACT COMMENT, --add-analysis IMPACT COMMENT
                        Add an impact analysis to a specific data ID (expect
                        --data-id). IMPACT should be either 0 (no impact) or 1
                        (impact), and COMMENT provide information
  --disprove-impact FIRST_ID LAST_ID
                        Disprove the impact of a group of data present in the
                        outcomes of '--data-with-impact-raw'. The group is
                        determined by providing the smaller data ID (FIRST_ID)
                        and the bigger data ID (LAST_ID).