Looking for the previous version? View v2024.06 documentation →
Bulk Data Comparison using Mapping File
Overview
Bulk Data Comparison using Mapping File scenarios import a pre-defined column mapping from a spreadsheet to configure comparisons across multiple tables. This approach is efficient when mappings are maintained externally by a data team.
Prerequisites
- You are logged in to Data Trust with a Pro-User or Admin Pro-User role.
- A mapping file in the supported format is available and source/target connections are configured.
Steps
Path: Data Trust › Scenario Studio › Scenario Builder › Bulk Data Comparison using Mapping File
Navigate to the Scenario Studio module and select the Bulk Data Comparison using Mapping File option from the left sidebar or main menu. This opens the scenario builder canvas where you will configure the data source connections, transformation rules, and execution settings.
Drag the Rdbms Widget from the widget palette and drop it onto the scenario canvas. Positioning the widget opens its configuration popup where you will set the connection, table, and any additional options.
Select the appropriate connection from the dropdown to link this widget to its data source. Choosing the correct connection profile ensures the scenario reads from or writes to the intended database or file system.
Drag the Target Rdbms Widget from the widget palette and drop it onto the scenario canvas. Positioning the widget opens its configuration popup where you will set the connection, table, and any additional options.
Select the appropriate connection from the dropdown to link this widget to its data source. Choosing the correct connection profile ensures the scenario reads from or writes to the intended database or file system.
Click the Save button to persist the current widget or scenario configuration. A confirmation indicator appears on the canvas once the save is successful, and the widget thumbnail updates to reflect the configured state.
Drag the Data Compare Widget from the widget palette and drop it onto the scenario canvas. Positioning the widget opens its configuration popup where you will set the connection, table, and any additional options.
The Reconciliation widget maps source fields to target fields for comparison. Use Smart Mapping to automatically propose column matches, then manually adjust any fields that were incorrectly paired before saving.
Navigate to the Scenario Studio module and select the Bulk Data Comparison using Mapping File option from the left sidebar or main menu. This opens the scenario builder canvas where you will configure the data source connections, transformation rules, and execution settings.
This step involves interacting with the Download Template within the Bulk Data Comparison using Mapping File workflow. Follow the on-screen prompts to complete this step before proceeding to the next configuration stage.
This step involves interacting with the Sample Template within the Bulk Data Comparison using Mapping File workflow. Follow the on-screen prompts to complete this step before proceeding to the next configuration stage.
This step involves clicking the Click on ipmprt file button within the Bulk Data Comparison using Mapping File workflow. Follow the on-screen prompts to complete this step before proceeding to the next configuration stage.
The Open File Popup dialog exposes all available configuration options for this step. Review each field carefully and fill in the required values before clicking Save or OK to apply the configuration.
The Reconciliation widget maps source fields to target fields for comparison. Use Smart Mapping to automatically propose column matches, then manually adjust any fields that were incorrectly paired before saving.
The Confirm Action Popup dialog exposes all available configuration options for this step. Review each field carefully and fill in the required values before clicking Save or OK to apply the configuration.
The Reconciliation widget maps source fields to target fields for comparison. Use Smart Mapping to automatically propose column matches, then manually adjust any fields that were incorrectly paired before saving.
Navigate to the Scenario Studio module and select the Bulk Data Comparison using Mapping File option from the left sidebar or main menu. This opens the scenario builder canvas where you will configure the data source connections, transformation rules, and execution settings.
Drag the Email Widget from the widget palette and drop it onto the scenario canvas. Positioning the widget opens its configuration popup where you will set the connection, table, and any additional options.
The Email widget sends an automated result notification to configured recipients after the scenario finishes executing. Provide the recipient addresses, subject, and choose whether to attach the exception report or include a summary in the email body.
Click the Execute button to trigger the scenario and begin processing data from the configured sources. The scenario transitions to Monitor mode where you can track real-time execution progress and view interim results as each step completes.
The Scenario Execution Summary page presents the full outcome of the scenario execution including record counts, match rates, and any detected exceptions. Drill into exception records to inspect individual mismatches and use the Export to CSV option to share results with stakeholders.
The Email widget sends an automated result notification to configured recipients after the scenario finishes executing. Provide the recipient addresses, subject, and choose whether to attach the exception report or include a summary in the email body.