Functional Data Reconciliation using Rest API as source

You are viewing archived documentation for Data Trust v2024.06 (previous version).
Go to the latest v7.6 documentation →

Functional Data Reconciliation using Rest API as source

Using FDR, users can compare a pair of data sets (source and target) to the field-by-field level. Now, let us compare Rest API (Source) with a Query Chain (target).

To learn more, let us walk through the below procedure:

• Click the ‘SCENARIO STUDIO’ module.
• Hover on the ‘Scenario Builder’ snippet from the left pane options.
• Click the ‘Functional Data Recon’ option.

Path 01: QUERY STUDIO > Scenario Builder > Functional Data Recon

• The user is navigated to the FDR Session page in create and edit mode.
• From the ‘Data Source’ tab, let’s drag and drop ‘REST API’ icon.
• Double tap the ‘Read data from <REST Api>’ widget.

• A ‘Read data from REST Api’ pop-up window is displayed.
• Add ‘Request URL’ as http://universities.hipolabs.com/search?name=middle
• Click the ‘Settings’ tab.

• Switch the ‘Enable SSL certificate verification’ toggle to ‘OFF’ mode.
• Click the ‘Get JSON Data’ button.

• A ‘Json Data’ pop-up window is displayed.
• Click the ‘Select’ button.

• This action populates the columns and data types.
• The user is navigated back to the ‘Read data from REST Api’ pop-up window.

Note: By default, all the column names and data types are selected and checked in.

• Click the ‘Save’ button.

• This action closes the ‘REST Api’ (Read data from REST Api) widget by saving its data.
• From the ‘Data Source’ tab, drag and drop a ‘Query Chain’ icon onto the FDR session page.
• Double tap the ‘Read data from Table’ widget.

• A ‘Read data from Table’ pop-up window is displayed.
• Select ‘QC-Rest API’ from the ‘Query Name’ column.

• Now, checkbox ‘QC-Rest API.’

Note: This action displays ‘Sessions’ and ‘Metadata’ tabs.

• Click the ‘Select’ button.

• This action closes the ‘Read data from Table’ pop-up window by saving its data.
• Click the ‘Transformations’ tab.

• Drag and drop ‘Filters’ icon onto the FDR session page.
• Double tap the ‘Filter data from < Data Source >’ widget.

• A ‘Filter data from < Data Source >’ pop-up window is displayed.
• Select ‘alpha_two_code’ from the ‘Available Fields’ drop-down list.
• Select ‘Equals to’ from the ‘Available Operators’ drop-down list.
• Select ‘input’ as ‘KW.’

Note: The user can notice the ‘Expression’ (alpha_two_code = ‘KW’) added under the ‘Expression’ field.

• Click the ‘Save’ button.

• This action closes the ‘Filter data from < Data Source >’ widget by saving its data.
• The user is navigated to the FDR session page.
• Click the ‘Reconciliation’ tab.

• Drag and drop the ‘Map source & target fields’ icon.
• Double-tap the ‘Map source & target fields’ widget.

• A ‘Map source & target fields’ pop-up window is displayed.
• Click the ‘Save’ button.

• A ‘Confirm action’ pop-up window is displayed.
• Click the ‘Verified’ button.

• This action closes the ‘Map source & target fields’ widget by saving its data.
• Click the ‘Additional Options’ tab.

• Drag and drop an ‘Email’ icon onto the FDR session page.
• Double tap the ‘Email settings’ widget.

• An ‘Email Settings’ pop-up window is displayed.
• Click the ‘Save’ button.

Note: Email ids were greyed due to confidential data.

• This action saves the ‘Email’ widget by saving its data.
• Click the ‘Execute Now’ button.

• A monitor mode is enabled.
• The FDR Scenario is Errored here.
• Click the ‘Map source & target fields’ Errored icon.

• The user is navigated to the ‘Functional Data Reconciliation Exceptions’ summary page.

• The FDR scenario email results are displayed in the below screenshot.