Bulk data comparison using mapping file – RightData

You are viewing archived documentation for Data Trust v2024.06 (previous version).
Go to the latest v7.6 documentation →

Bulk Data comparison using mapping file

Using TDR, users can perform a row count of data comparison between multiple pairs of data sets. Let’s perform bulk data comparison using a mapping file.

To learn more, let us walk through the below procedure:

Click the SCENARIO STUDIO module.
Hover on the Scenario Builder snippet from the left pane options.
Click the Technical Data Recon option.

The user is navigated to a new TDR session page in create and edit mode.
From the Data Source tab, let’s drag and drop an RDBMS Tables icon on to the TDR session page.
Double tap the RDBMS Tables widget.

An RDBMS Tables pop-up window is displayed.
Let’s select Redshift from the Database Type drop-down list.
Select Redshift-QA from the Connection Name drop-down list.

Note: As the user selects the Connection Name drop-down list, the Parallelism, Packet Size along with Server, Database, Port, and User Id are populated.

Click the Select button.

The RDBMS Table widget is closed saving the widget data and further collapsing into the TDR session page in create and edit mode.
From the Data Source tab, drag and drop an RDBMS Tables widget as Target Data Source.
Double tap on the RDBMS Tables widget.

An RDBMS Tables pop-up window is displayed.
Let’s suppose, select Database Type as Redshift and Connection Name as Redshift-JDBC.
Click the Select button.

The RDBMS Tables widget is closed saving the data and collapsing into the TDR session page in create and edit mode.
Click the Compare tab.

Drag and drop the Data Compare icon onto the TDR session page in create and edit mode and double tap on it.

A Data Compare pop-up window is displayed.
Click the Upload Mappings icon.

An Upload Mappings pop-up window is displayed.
Click on the Download mapping template to download the sample upload mapping template.

Open the sample mapping template file.

We need to add the respective fields as per the below sample document.

Let’s upload a mapping file by clicking on the Import from file button.

Let’s select a file from the local drive and click on Open.

This action uploads the source and target fields for comparison.
Click on Map button.

A Confirm Action pop-up window is displayed.
Click on Yes button.

All the source and target fields mappings are updated.
Click on Save button.

The Data Compare widget is closed saving the widget data and collapsing into the TDR session page in edit mode.
Click the Additional Options tab.

From the Additional Options tab, drag and drop the Email icon onto TDR create and edit page.
Click the Email Settings widget.

An Email Settings pop-up window is displayed.
Click the Save button.

The Email Settings widget is closed saving the data and collapsing into the TDR session page in create and edit mode.
Click the Execute Now button.

The user is navigated to a new tab displaying the Scenario Execution Summary results of that particular TDR Scenario.

The TDR execution results are forwarded to the email address as shown here.