Looking for the previous version? View v2024.06 documentation →
Comparing CSV File with RDBMS Table
Overview
This guide shows how to create an FDR scenario that compares a CSV file against an RDBMS table. The CSV file is configured as the source and the database table as the target, and the scenario identifies rows and fields that differ between the two.
Prerequisites
- You are logged in to Data Trust with a Pro-User or Admin Pro-User role.
- A CSV connection profile and an RDBMS connection profile have been configured.
Steps
Path: Data Trust › Scenario Studio › Scenario Builder › Comparing CSV File with RDBMS Table
Navigate to the Scenario Studio module and select the Comparing CSV File with RDBMS Table option from the left sidebar or main menu. This opens the scenario builder canvas where you will configure the data source connections, transformation rules, and execution settings.
The Comparing CSV File with RDBMS Table create page is the starting point for building a new scenario. Provide a name for the scenario, choose the appropriate folder, and then proceed to configure data sources and execution logic on the canvas.
Select the appropriate connection from the dropdown to link this widget to its data source. Choosing the correct connection profile ensures the scenario reads from or writes to the intended database or file system.
The Preview Data option fetches a sample of records from the selected table to verify the connection and column structure. Confirm that the correct columns and sample data are visible before closing the preview and saving the widget.
Navigate to the Scenario Studio module and select the Comparing CSV File with RDBMS Table option from the left sidebar or main menu. This opens the scenario builder canvas where you will configure the data source connections, transformation rules, and execution settings.
The Preview Data option fetches a sample of records from the selected table to verify the connection and column structure. Confirm that the correct columns and sample data are visible before closing the preview and saving the widget.
This step involves interacting with the Override Datatyp within the Comparing CSV File with RDBMS Table workflow. Follow the on-screen prompts to complete this step before proceeding to the next configuration stage.
The RDBMS Popup dialog exposes all available configuration options for this step. Review each field carefully and fill in the required values before clicking Save or OK to apply the configuration.
This step involves interacting with the Table Select within the Comparing CSV File with RDBMS Table workflow. Follow the on-screen prompts to complete this step before proceeding to the next configuration stage.
The Preview Data option fetches a sample of records from the selected table to verify the connection and column structure. Confirm that the correct columns and sample data are visible before closing the preview and saving the widget.
The Map and Recon popup dialog exposes all available configuration options for this step. Review each field carefully and fill in the required values before clicking Save or OK to apply the configuration.
Click the Save button to persist the current widget or scenario configuration. A confirmation indicator appears on the canvas once the save is successful, and the widget thumbnail updates to reflect the configured state.
Click the Execute button to trigger the scenario and begin processing data from the configured sources. The scenario transitions to Monitor mode where you can track real-time execution progress and view interim results as each step completes.
This step involves interacting with the Execution Completed within the Comparing CSV File with RDBMS Table workflow. Follow the on-screen prompts to complete this step before proceeding to the next configuration stage.
Navigate to the Scenario Studio module and select the Comparing CSV File with RDBMS Table option from the left sidebar or main menu. This opens the scenario builder canvas where you will configure the data source connections, transformation rules, and execution settings.
This step involves interacting with the Execution Log within the Comparing CSV File with RDBMS Table workflow. Follow the on-screen prompts to complete this step before proceeding to the next configuration stage.
The Scenario Execution Summary page presents the full outcome of the scenario execution including record counts, match rates, and any detected exceptions. Drill into exception records to inspect individual mismatches and use the Export to CSV option to share results with stakeholders.
The Result Summary page presents the full outcome of the scenario execution including record counts, match rates, and any detected exceptions. Drill into exception records to inspect individual mismatches and use the Export to CSV option to share results with stakeholders.
This step involves interacting with the Key Exists in source & Target but data difference within the Comparing CSV File with RDBMS Table workflow. Follow the on-screen prompts to complete this step before proceeding to the next configuration stage.