Using FDR, users can compare a pair of data sets (source and target) to the field-by-field level and this option is the most comprehensive way to reconcile data between all right data supported data sources. Let’s compare CSV data (Source Data) with ‘RDBMS’ data (Target Data).
To learn more, let us walk through the below procedure:
- Click the ‘SCENARIO STUDIO’ module.
- Hover on the ‘Scenario Builder’ snippet from the left pane options.
- Click the ‘Functional Data Recon’ option.
Path 01: QUERY STUDIO > Scenario Builder > Functional Data Recon
- From the Data Source tab, drag and drop the ‘CSV’ icon onto the FDR session page in create and edit mode.
- Double tap the ‘Read data from <CSV file>’ widget.
- A ‘Read data from CSV file’ pop-up window is displayed.
- Switch the ‘Choose file from’ toggle button to ‘Local.’
- Click the (plus) ‘+ Choose a CSV/TSV/TXT file’ to browse and load a CSV file from the local drive.
- The CSV file details are updated as shown here.
- Click the ‘Select’ button.
- This action closes the ‘CSV’ widget by saving its data.
- From the ‘Data Source’ tab, drag and drop another ‘RDBMS Table’ icon.
- Double tap the ‘RDBMS Table’ (Read data from Table) widget.
- A ‘Read data from Table’ pop-up window is displayed.
- Let’s select Database Type as ‘PostgreSQL’ from the drop-down list.
- Select Connection Name as ‘PostgreSQL Northwind-QA’ from the drop-down list.
- Click the Navigator button.
- A ‘Navigator’ slide screen is displayed.
- Select and click the ‘orders’ table from the ‘Public’ schema.
- Click the ‘Select’ button.
Note: You can directly use filters and aggregation transformations from the RDBMS Tables widget. This is a new enhancement added as a part of 2022.09 release. As of now, this enhancement works only with FDR and Query Chain.
- This action closes the ‘RDBMS Table’ (Read data from Table) widget by saving its data.
- Click the ‘Transformations’ tab.
- Drag and drop the ‘Filters’ icon onto the FDR session page.
- Double tap the ‘Filter data from < Data Source >’ widget.
- A ‘Filter’ pop-up window is displayed.
- Select ‘productid’ from the ‘Available Fields’ drop-down list, ‘Greater than’ from the ‘Available Operators’ drop-down list, and input as 20.
- Click the ‘Save’ button.
- This action closes the ‘Filters’ (productid > ‘20’) widget by saving its data.
- Click the ‘Reconciliation’ tab.
- Drag and drop ‘Map source & target fields’ icon onto the FDR session page.
- Double tap the ‘Map source & target fields’ widget.
- A ‘Map source & target fields’ pop-up window is displayed.
- Click the ‘Save’ button.
- A ‘Confirm Action’ pop-up window is displayed.
- Click the ‘Verified’ button.
- This action closes the ‘Map source & target fields’ widget by saving its data.
- Click the ‘Execute Now’ button.
- A ‘Monitor mode’ is enabled.
- The scenario is ‘Failed’ here.
- Click on the ‘Map source & target fields’ widget count (13).
- The user is navigated to the ‘Functional Data Reconciliation Exceptions’ summary page.