Data Wrangling
Single Line to Multiline
Description :
Single Line to Multiline operation is used to convert Single Line JSON to Multiline JSON.
The resulting JSON string can be used to store or transmit data in a structured format.
Number of Parameters : 1
Parameter : Chopkey
Below is an example where we are using chopkey operation on dataset_response
"['dataset_response']['data']",Delimiter to JSON
Description :
Delimiter to JSON operation is used to convert Delimiter to JSON.
The resulting JSON string can be used to store or transmit data in a structured format.
Number of Parameters : 6
Parameter : Key_data
Key_data adds a new key-value to each record, the user can iterate through the records and add the new key-value to each one.
Below is an example where we are using DataTable as key.
"['DataTable']"Parameter : Delimiter
Delimiter is used to separate values in a list, record, or file.
Below is an example where we are using "," as delimiter.
","Parameter : Fields
Files is used in to specify headers name.
Below is an example where we are using values like Customer ID, Organization Name, Month and Item as header name.
"Customer ID","Organization Name","Month","Item"Parameter : Autodetect_column_names
Autodetect_column_names are for same header which is flat file "true" otherwise false
Below is an example where for same header is flat file "true" otherwise false.
"false"
Parameter : Skip_header
Skip_header uses "false" if the user wants firstline of flatfile as headers
Below is an example where we are using false in firstline of flatfile as headers.
"true" Parameter : Response_key
Response_key is the key in which the user's JSON data will be stored.
Below is an example where we using datatable to store the JSON data
"datatable"
JSON to Delimiter
Description :
JSON to Delimiter is used to convert JSON to Delimiter that represents the object.
The resulting Delimiter can be used to store or transmit data in a structured format.
Number of Parameters : 6
Parameter : Key_data
Key_data adds a new key-value to each record, the user can iterate through the records and add the new key-value to each one.
Below is an example where we using items as key data
'items'Parameter : Delimiter
Delimiter is used to separate values in a list, record, or file.
Below is an example where we using \t as delimiter.
"\t"Parameter : Fields
Files is used in to specify headers name.
Below is an example where we are using values like Item1,Item2 and Item3 as header name.
"Item1","Item2","Item3" Parameter : Autodetect_column_names
Autodetect_column_names adds a new key on the fly with its value as a static value or dynamic value. This will add key and its value for each record.
Below is an example where for same header is flat file true otherwise false.
"true"Parameter : Skip_header
Skip_header uses "false" if the user wants firstline of flatfile as headers
Below is an example where we are using false in firstline of flatfile as headers.
"false"Parameter : Response_key
Response_key is the key in which our delimiter data will be stored
Below is an example where we using delimiter_data to store the JSON data
"delimiter_data"
Data Aggregation
Description:
Data aggregation is used for the processing of raw data, this will also help in the grouping, summarizing, and processing of the data to make it easier to understand and analyze.
Number of Parameters : 3
Parameter : Agg_data_key
Agg_data_key is used to empty for multiline data and will have data key in case of single line data.
Below is an example where we using ":" as agg_data_key
":"
Parameter : Groupby_key
Groupby_key gives key name that the user wants to group by, basically this is a unique identifier in the dataset.
Below is an example where we using Orders as Groupby_key as a unique identifier of a dataset which is having Order and Order Line Items.
"Orders"Parameter : Array_key
Array_key gives the key name where the user wants to hold the common keys, the user can provide any key name
Below is an example where we using Order Lines as array key.
"Order Lines"
Parameter : Array_key_nested_columns
Array_key_nested_columns gives the key name as comma separated keys that should be reflected in the level of groupby_key. This will be outside the array key.
Below is an example where we using id, name and year as column names
"id","name","year"Unpivot
Description:
Unpivot operation helps in the data transformation process.
Number of Parameters : 2
Parameter : Transpose_key_name
Transpose_key_name used in specify name of key which needs to be transposed
Below is an example where we using bucket_type and bucket_value as values that needs to be transpose.
"bucket_type","bucket_value"
Parameter : Transpose value
Transpose value used in specify the values which needs to be transposed
Below is an example where the transpose values are on_hand, purchase_orders and goods_in_transit
"on_hand", "purchase_orders","goods_in_transit"
Pivot
Description:
Pivot operations are used in pivoting data, which involves converting long data to wide data. They are often used in data analysis to transform data into an easier format.
Number of Parameters : 3
Parameter : Get key
Get key is used to empty for multiline data and will have get key in case of single line data.
Below is an example where we are using ":" as get key.
":"Parameter : Transpose_key_name
Transpose_key_name specifies name of the key which needs to be transposed.
Below is an example where we are using Item Id and Item Name as key name.
"Item Id","Item Name"
Parameter : Transpose value
Transpose value specifies which values needs to be transposed.
Below is an example where we are using some particular item ids to be transposed OrderID-1, OrderID-2, OrderID-3
"OrderID-1", "OrderID-2", "OrderID-3"Single Line to Tuple
Description:
Single Line to Tuple operation is used to convert a single line of data to a tuple.
Number of Parameters : 3
Parameter : Singleline_key
Singleline_key helps in reading the dataset from a single line.
Below is an example where we are using a key DataTable to read the data from a single line
"DataTable"Parameter : Table_headers
Table_headers specifies the key name that is available inside the array.
Below is an example where we are using a key names Item, Customer and Month that are available inside the arrays
"Item","Customer","Month"Parameter : Tuple_key
Tuple_key is the key which is used to save the tuple data.
Below is an example where we are using datatable as tuple key.
datatableTuple to Singleline
Description:
Tuple to Singleline operation is used in convert a tuple to a single line, which involves taking a tuple and converting it to a singleline string.
Number of Parameters : 3
Parameter : Singleline_key
Singleline_key is used to read the user's tuple data.
Below is an example where we are using DataTable to read the tuple data .
'DataTable'Parameter : Table_headers
Table_headers are the headers or key name of the new JSON.
Below is an example where we are using Item, Customer and Month as the new header names.
"Item","Customer","Month"Parameter : Tuple_key
Singleline_key helps in to save the new data.
Below is an example where we are using datatable as tuple key.
"datatable"