Data Transformation

Upper Case

Description

This operations helps to convert a given key value into Upper Case from any JSON Dataset. This operations take place while data is in-flight

Number of Parameters : 1

Parameter : Uppercase

Provide comma separated list of keys in double quotes to convert the defined key values into Upper Case

Below is a example where we are converting the value of first_name and last-named into Upper Case

"first_name", "last_name"

Lower Case

Description

This operations helps to convert a given key value into Lower Case from any JSON Dataset. This operations take place while data is in-flight

Number of Parameters : 1

Parameter : Lowercase

Provide comma separated list of keys in double quotes to convert the defined key values into Lower Case

Below is a example where we are converting the value of first_name and last_name into Lower Case

 "first_name", "last_name"

Data Type

Description

Data type operation can convert any stringkey's of boolean, float, integer and datetimevalue into JSON datatypedata oftype boolean,like

1. float,Boolean into JSON data type boolean
2. Float into JSON data type float
3. Integer into JSON data type integer
4. andDatetime datetime.into JSON data type datetime

Number of Parameters : 4

Parameter : Boolean

A Boolean can be converted into every key's string value into a Boolean value. In JSON data,data type boolean.
Booleans do not contain double quotes.
Example:Below is a example where we are converting the values of true and false into into JSON data type boolean.

true or false

Parameter : Float

Convert any string likeA float can be converted into JSON data type float
Below is a example where we are converting the value of Amount into JSON data type float.
Example:

"Amount"

Parameter : Integer

Convert any string likeAn integer can be converted into JSON data type integer
Below andis alsoa convertsexample anywhere stringwe likeare floatconverting the value of Quantity into integer and convert a floatJSON data type intoInteger.

integer.
Example:

"Quantity"

Parameter : Date Time

CanA convertDate anyTime stringcan likebe dateconverted into JSON data type date and can change the format of date.time. 

From date format : The date/datetime format in which the user is defining their date/datetime.
To date format : The date/datetime format in which the user wants to convert their date/datetime.

Examples-[Below is a example where we are convert From date format to  To date format inside JSON data type Integer.

"key_name","From date format","To date format"]

Append

Description: 

Append operation dynamically or statically adds a new key with a value on the fly, which will add key and its value for each record.

Number of Parameters : 1

Parameter : Append

By adding new elements to the end of an existing data structure, the append operation can help to extend or modify the data structure in a flexible and efficient way.

For dynamic value the user can use {{column_name}} where column_name is the incoming column in the data pipeline
Example

Below is a example where a adding a new key in-flight with its fixed value.

"export_flag_y":"Y","export_flag_p":"P"

Title Case

Description:

ItTitle aidsCase operation helps in the conversionconverting of a given key value into title case. 

Number of Parameters : 1

Parameter : Title Case

Title case converts a given key value into title case for any given key nameProvide comma separated list of keys in double quotes.quotes to convert the defined key values into Title Case
Example:Below "Titlecase":is a example where we are converting the values of amount and value into Title Case.
 

["amount","value"]

Data Extractor

Description: 

Data Extractor operation is designed to extract specific data from JSON response. The data can be in various formats.

Number of Parameters : 2

Parameter : Data_Extractor

Data_Extractor is used to extract keys and its value from a JSON responseresponse.

Parameter :Data_Extractor_Keys

This helps to provide user defined keys. If left blank it will auto generate keys.
Example:

Below

is a example where we are extracting the values of access_token and feedDocumentId.

"['access_token']","['feedDocumentId']"

Trim 

Description: 

Trim operation helps in removing unnecessary parts from the given key's value as defined by the user.

Number of Parameters : 1

Parameter :

It trims the given key's value,

Provide comma separated list of keys in double quotes to trim the defined key values.
Example:Below is a example where we will trim the defined key value first_name

"first_name"

JSON to String

Description: 

JSON to String operation is used to convert JavaScript object or value as its parameter and returns a JSON string that represents the object. The resulting JSON string can be used to store or transmit data in a structured format.

Number of Parameters : 1

Parameter : Json2stringJSON to String

Provide comma separated list of keys in double quotes,quotes forto convert the defined key values thatfrom needJSON to be converted.String.
Example:Below "json2string":[is a example where we are converting the value of key1 and key2 from JSON to String

"key1","key2"]

String to JSON

Description: 

String to JSON operation is used to convertsconvert a string object or value as its parameter and returns a JSON string that represents the object in a specific format required by the user.format. 

Number of Parameters : 1

Parameter : String2jsonString to JSON

Provide comma separated list of keys in double quotes,quotes forto convert the defined key values thatfrom needString to be converted.JSON
Example:Below is a example where we are converting the value of key1 and key2 from JSON to String

["stringkey1","key2"]

2json":["key1","key2"]

JSON to XML

Description: 

JSON to XML operation helpsis used to convert JSON object or value as its parameter and returns a XML that represents the object. The resulting XML can be used to store or transmit data in a structured format.

Number of Parameters : 2

Parameter : Key_data

Key_data converts the provided Key'key's value from JSON to XML.

Parameter : Response_key

Response_key take note of the converted value under the specified key name which is easy to access.
Example:

Below is a example where we are converting the value of product_data_response and the response key will be data_response

"product_data_response"
"data_response"

 

XML to JSON

Description: 

XML to JSON is used to convert XML object or value as its parameter and returns a JSON that represents the object. The resulting JSON can be used to store or transmit data in a structured format.

Number of Parameters : 2

Parameter : Get_key

Get_key converts the provided Key's value from XML to JSON

.

Parameter : Response_key

Response_key take note of the converted value under the specified key name which is easy to access.
Example:
Below is a example where we are converting the value of product_data_response and the response key will be data_response.

"product_data_response"
"data_response"

Base64 Encoding

Description: 

Base64 operation is used when the user want to convert some specific key to base64, the user can use multiple 
keys if they require.

Number of Parameters : 1

Parameter : Base64_encode

Used to encode the values of given key into base64
Example:Below is a example where we are converting the value of email into Base64.

"email"

Base64 Decoding

Description: 

Base64 decoding operation is used to converting a Base64-encoded string back to its original data format.

Number of Parameters : 1

Parameter : Base64_decode

ConvertsBelow is a example where we are converting the provided key's base64 value intoof aemail stringback byto decoding it.Base64.
Example:

"email"

Generate Array Sequence Number

Description:

Generate Array Sequence Number is a single line of data that presents the sequence the user wants to specify.

Number of Parameters : 2

Parameter : Sequence_key

It is the key name in which the single line data is present whose sequence the user needs to give.

Parameter : Sequence_number_key

It is the name of the new key for sequence
Example:Below is a example where we are converting the value of key_name and the sequence key will be DATA.

"key_name"
"DATA"

Send Keys top of Root

Description:

Column_to_root isoperation thehelps in giving key's value specify by the user. User should provide the key name comma separated in double quotes in square bracketsvalue.

Number of Parameters : 1

Parameter : Column_to_root

column_to_root
Provide :comma column_to_rootseparated list of keys in double quotes to specify the key's value.
Below is a example where we are giving the given key's value of key_name.
Example-["Amount"]

key_name

Today Timestamp

Description:

Today Timestamp operation helps to convert any time stamp tointo the required date and time format.

Number of Parameters : 2

Parameter : Date_format

Date_format used to pass the required format.

Parameter : Datetime_key

Datetime_key is the name of key in which the user wants to save their date
Below is a example where we will convert the now timestamp to region based instance into ISO Date Format, where date format is %Y-%m-%dT%H:%M:%S.%f%z  and datetime_key is dl_insert_date.

"%Y-%m-%dT%H:%M:%S.%f%z"
"dl_insert_date"

Round

Description:

Round operation is used to reduce a number to a specific number of decimal places, where the numbers need to be rounded off.

Number of Parameters : 2

Parameter : Round_keys

Round_keys is used to access the specific key that needs to be roundoff, define by the user.

Parameter : Decimal_key_number

Decimal_key_number specifies which decimal places the user needs.
User should provide the key name
Provide comma separated list of keys in double quotes.quotes to specify the value.
Below is a example where we are rounding off the value of float_value and int_value.

"float_value", "int_value"

Example:

Calculator

Description: 

Calculator operations are used when a calculated field with sustaining formulas related to any particular process is provided, by the user.

Number of Parameters : 2

Parameter : Calculation_keys

Calculation_keys are used when keys with calculating formula is available. 

Parameter : New_calculation_keys

New_calculation_keys used to  store the calculated values.

User should provide the key nameProvide comma separated list of keys in double quotes.quotes to specify the value.
Below is a example where we are providing calculated fields of Amount1 - Amount2 and Amount1 + Amount2 and new keys
Example:are key1 and key2

"Amount1 - Amount2", "Amount1 + Amount2"
"key1","key2"

Date Analytics

Description: 

Date analytics is used to specify and define various date formats based on the specification.

Number of Parameters : 4

Parameter : Data_field_key

Data_field_key

Data_field_key is a name or code that is used to identify a particular data field.

Parameter : Fiscal_month_start 

Fiscal_month_start is used to specify the start date of a fiscal month, which is a period of time used by organizations to track their financial performance.

Parameter : Date_column

Date_column is used for new date column key name for saving data.

Parameter : Weekday

Weekday is used to specify the starting of the week.

Repeat First Row Values

Description:

Repeat First Row Values operation is  used when working with time series data or other data sets where values are expected to remain constant for a certain period of time.

Number of Parameters : 2

Parameter : Source_key

Source_key helps in reading the dataset from a single line.

Parameter : Fields_to_repeat_value

Fields_to_repeat_value is an array of column name's whose first row value we want to repeat.
Example:
Below is a example where we are providing calculated fields of Amount1 - Amount2 and Amount1 + Amount2 and new keys
are key1 and key2