Skip to main content

Data Transformation

Upper Case

Description

This operations helps to convert a given key value into Upper Case from any JSON Dataset. This operations take place while data is in-flight

Number of Parameters : 1

Parameter : Uppercase

Provide comma separated list of keys in double quotes to convert the defined key values into Upper Case

Below is a example where we are converting the value of first_name and last-named into Upper Case

"first_name", "last_name"

Lower Case

Description

This operations helps to convert a given key value into Lower Case from any JSON Dataset. This operations take place while data is in-flight

Number of Parameters : 1

Parameter : Lowercase

Provide comma separated list of keys in double quotes to convert the defined key values into Lower Case

Below is a example where we are converting the value of first_name and last_name into Lower Case

 "first_name", "last_name"


Data Type

Description

Data type operation can convert any key's value into JSON data type like

1. Boolean into JSON data type boolean
2. Float into JSON data type float
3. Integer into JSON data type integer
4. Datetime into JSON data type datetime

Number of Parameters : 4

Parameter : Boolean

A Boolean can be converted into JSON data type boolean.
Booleans do not contain double quotes.
Below is a example where we are converting the values of true and false into into JSON data type boolean.

true or false

Parameter : Float

A float can be converted into JSON data type float
Below is a example where we are converting the value of Amount into JSON data type float.

"Amount"


Parameter : Integer

An integer can be converted into JSON data type integer
Below is a example where we are converting the value of Quantity into JSON data type Integer.

"Quantity"

Parameter : Date Time

A Date Time can be converted into JSON data type date time. 

From date format : The date/datetime format in which the user is defining their date/datetime.
To date format : The date/datetime format in which the user wants to convert their date/datetime.

Below is a example where we are convert From date format to  To date format inside JSON data type Integer.

"key_name","From date format","To date format"


Append

Description: 

Append operation dynamically or statically adds a new key with a value on the fly, which will add key and its value for each record.

Number of Parameters : 1

Parameter : Append

By adding new elements to the end of an existing data structure, the append operation can help to extend or modify the data structure in a flexible and efficient way.

For dynamic value the user can use {{column_name}} where column_name is the incoming column in the data pipeline

Below is a example where a adding a new key in-flight with its fixed value.

"export_flag_y":"Y","export_flag_p":"P"


Title Case

Description:

Title Case operation helps in the converting of a given key value into title case. 

Number of Parameters : 1

Parameter : Title Case

Provide comma separated list of keys in double quotes to convert the defined key values into Title Case
Below is a example where we are converting the values of amount and value into Title Case.
 

["amount","value"]


Data Extractor

Description: 

Data Extractor operation is designed to extract specific data from JSON response. 


Number of Parameters : 2

Parameter : Data_Extractor

Data_Extractor is used to extract keys and its value from a JSON response.

Parameter :Data_Extractor_Keys

This helps to provide user defined keys. If left blank it will auto generate keys.
Below is a example where we are extracting the values of access_token and feedDocumentId.

"['access_token']","['feedDocumentId']"

Trim 

Description: 

Trim operation helps in removing unnecessary parts from the given key's value as defined by the user.

Number of Parameters : 1

Parameter :

Provide comma separated list of keys in double quotes to trim the defined key values.
Below is a example where we will trim the defined key value first_name

"first_name"



JSON to String

Description: 

JSON to String operation is used to convert JavaScript object or value as its parameter and returns a JSON string that represents the object.

Number of Parameters : 1

Parameter : JSON to String

Provide comma separated list of keys in double quotes to convert the defined key values from JSON to String.
Below is a example where we are converting the value of key1 and key2 from JSON to String

"key1","key2"



String to JSON

Description: 

String to JSON operation is used to convert a string object or value as its parameter and returns a JSON  that represents the object in a specific format. 


Number of Parameters : 1

Parameter : String to JSON

Provide comma separated list of keys in double quotes to convert the defined key values from String to JSON
Below is a example where we are converting the value of key1 and key2 from JSON to String

["key1","key2"]



JSON to XML

Description: 

JSON to XML operation helps to convert JSON object or value as its parameter and returns a XML that represents the object.

Number of Parameters : 2

Parameter : Key_data

Key_data converts the provided key's value from JSON to XML.

Parameter : Response_key

Response_key take note of the converted value under the specified key name which is easy to access.

Below is a example where we are converting the value of product_data_response and the response key will be data_response

"product_data_response"
"data_response"

 

XML to JSON

Description: 

XML to JSON is used to convert XML object or value as its parameter and returns a JSON that represents the object. 


Number of Parameters : 2

Parameter : Get_key

Get_key converts the provided Key's value from XML to JSON

Parameter : Response_key

Response_key take note of the converted value under the specified key name which is easy to access.

Below is a example where we are converting the value of product_data_response and the response key will be data_response.

"product_data_response"
"data_response"


Base64 Encoding

Description: 

Base64 operation is used to convert some specific key to base64, the user can use multiple 
keys if they require.


Number of Parameters : 1

Parameter : Base64_encode

Used to encode the values of given key into base64
Below is a example where we are converting the value of email into Base64.

"email"


Base64 Decoding

Description: 

Base64 decoding operation is used to converting a Base64-encoded string back to its original data format.


Number of Parameters : 1

Parameter : Base64_decode

Below is a example where we are converting the value of email back to Base64.

"email"



Generate Array Sequence Number

Description:

Generate Array Sequence Number is a single line of data that presents the sequence the user wants to specify.


Number of Parameters : 2

Parameter : Sequence_key

It is the key name in which the single line data is present whose sequence the user needs to give.

Parameter : Sequence_number_key

It is the name of the new key for sequence
Below is a example where we are converting the value of key_name and the sequence key will be DATA.

"key_name"
"DATA"



Send Keys top of Root

Description:

Column_to_root operation helps in giving key's value.


Number of Parameters : 1

Parameter : Column_to_root


Provide comma separated list of keys in double quotes to specify the key's value.
Below is a example where we are giving the key's value of key_name.

key_name


Today Timestamp

Description:

Today Timestamp operation helps to convert any time stamp into the required date and time format.

Number of Parameters : 2

Parameter : Date_format

Date_format used to pass the required format.

Parameter : Datetime_key

Datetime_key is the name of key in which the user wants to save their date
Below is a example where we will convert the now timestamp to region based instance into ISO Date Format, where date format is %Y-%m-%dT%H:%M:%S.%f%z  and datetime_key is dl_insert_date.

"%Y-%m-%dT%H:%M:%S.%f%z"
"dl_insert_date"




Round

Description:

Round operation is used to reduce a number to a specific number of decimal places, where the numbers need to be rounded off.

Number of Parameters : 2

Parameter : Round_keys

Round_keys is used to access the specific key that needs to be roundoff, define by the user.

Parameter : Decimal_key_number

Decimal_key_number specifies which decimal places the user needs.

Provide comma separated list of keys in double quotes to specify the value.
Below is a example where we are rounding off the value of float_value and int_value.

"float_value", "int_value"



Calculator

Description: 

Calculator operations are used when a calculated field with sustaining formulas related to any particular process is provided, by the user.

Number of Parameters : 2

Parameter : Calculation_keys

Calculation_keys are used when keys with calculating formula is available. 

Parameter : New_calculation_keys

New_calculation_keys used to  store the calculated values.

Provide comma separated list of keys in double quotes to specify the value.
Below is a example where we are providing calculated fields of Amount1 - Amount2 and Amount1 + Amount2 and new keys
are key1 and key2

"Amount1 - Amount2", "Amount1 + Amount2"
"key1","key2"




Date Analytics

Description: 

Date analytics is used to specify and define various date formats based on the specification.


Number of Parameters : 4

Parameter : Data_field_key

Data_field_key

Data_field_key is a name or code that is used to identify a particular data field.

Parameter : Fiscal_month_start 

Fiscal_month_start is used to specify the start date of a fiscal month, which is a period of time used by organizations to track their financial performance.

Parameter : Date_column

Date_column is used for new date column key name for saving data.

Parameter : Weekday

Weekday is used to specify the starting of the week.



Repeat First Row Values

Description:

Repeat First Row Values operation is used when working with time series data or other data sets where values are expected to remain constant for a certain period of time.

Number of Parameters : 2

Parameter : Source_key

Source_key helps in reading the dataset from a single line.

Parameter : Fields_to_repeat_value

Fields_to_repeat_value is an array of column name's whose first row value we want to repeat.

Below is a example where we are providing calculated fields of Amount1 - Amount2 and Amount1 + Amount2 and new keys
are key1 and key2