Pushdown reconciliation

When the source and target of a scenario is using the same connection profile, then users now can perform push-down reconciliations. This option can improve the performance of the reconciliation process by 5X – 100X. This option avoids the need for the data to be ingested into RightData and pushes the reconciliation logic to the source system itself.

To learn about the Pushdown reconciliation, let us walk through the below procedure:

• Click the ‘SCENARIO STUDIO’ tab.
• Hover on the ‘Scenario Builder’ snippet from the left pane options.
• Click the ‘Functional Data Recon’ (FDR) option.

Note: The user can either click the ‘Functional Data Recon’ option or ‘Create FDR Scenario’ button to open a new FDR Scenario session page.

• The user is navigated to a new FDR session page in create and edit mode.

• From the ‘Data Source’ tab, let’s drag and drop an ‘RDBMS Table’ icon onto FDR session page.
• Click the ‘RDBMS Table’ (Read data from Table) widget.

• A ‘Read data from Table’ pop-up window is displayed and has ‘Database Type’ and ‘Connection Name’ drop-down lists.

Note: The ‘Pick Table’ option is enabled as the user selects the ‘Connection Name’ drop-down list.

• Let’s select ‘SNOW FLAKE’ for the ‘Database Type’ drop-down list and ‘Snowflake_AWS’ for the ‘Connection Name’ drop-down list.
• A green tick appears indicating the ‘Connection Name’ drop-down list selection is successful.
• Click the ‘Additional Settings’ button.

• An ‘Additional Settings’ pop-up window is displayed with different text field options such as Parallelism, Packet Size, and Packetize By.

Note: By default, Parallelism is set to ‘1’ and Packet Size to ‘50000’.

• A ‘Reset to Default’ button is available if the user wants to reset ‘Parallelism’ and ‘Packet Size’ to default values.
• When hovered on the ‘info’ button on the ‘Additional Settings’ pop-up window the user is assisted with information.
• Click the ‘Save’ button to save the ‘Additional Settings’.
• The moment the settings are saved the ‘Additional Settings’ pop-up window is closed and the user is navigated back to the ‘Read data from Table’ window.

• Click the ‘Navigator’ button.

• A ‘Navigator’ slide screen is displayed on the right-hand side.
• A ‘Refresh’ button is used to refresh the ‘Navigator’ session page.
• Let’s select the ‘COLUMNS’ table.

• Click the ‘COLUMNS’ to add and display the table.
• Click the ‘Select’ button.

Note: You can directly use filters and aggregation transformations from the RDBMS Tables widget. This is a new enhancement added as a part of 2022.09 release. 

• The ‘RDBMS Table’ widget is closed saving the widget data.
• The user is navigated to the FDR session page.

• From the ‘Data Source’ tab, drag and drop the target ‘RDBMS Table’ icon onto FDR session page.

Note: All the Data Source icons including ‘RDBMS Table’ get disabled as the user drags and drops another comparison widget on to FDR create and edit page.  

• Click the ‘RDBMS Table’ widget.

• A ‘Read data from Table’ pop-up window is displayed and has ‘Database Type’ and ‘Connection Name’ drop-down lists.

Note: The ‘Pick Table’ option is enabled as the user selects the ‘Connection Name’ drop-down list.

• Let’s select ‘SNOW FLAKE’ for the ‘Database Type’ drop-down list and ‘Snowflake_AWS’ for the ‘Connection Name’ drop-down list.
• A green tick appears indicating the ‘Connection Name’ drop-down list selection is successful.
• Click the ‘Additional Settings’ button.

• An ‘Additional Settings’ pop-up window is displayed with different text field options such as Parallelism, Packet Size, and Packetize By.

Note: By default, Parallelism is set to ‘1’ and Packet Size to ‘50000’.

• A ‘Reset to Default’ button is available if the user wants to reset ‘Parallelism’ and ‘Packet Size’ to default values.
• When hovered on the ‘info’ button on the ‘Additional Settings’ pop-up window the user is assisted with information.
• Click the ‘Save’ button to save the ‘Additional Settings’.
• The moment the settings are saved the ‘Additional Settings’ pop-up window is closed and the user is navigated back to the ‘Read data from Table’ window.

• Click the ‘Navigator’ button.

• A ‘Navigator’ slide screen is displayed on the right-hand side.
• A ‘Refresh’ button is used to refresh the ‘Navigator’ session page.
• Let’s select the ‘DATABASES’ table.

• Click the ‘DATABASES’ to view the table.
• Click the ‘Select’ button.

Note: You can directly use filters and aggregation transformations from the RDBMS Tables widget. This is a new enhancement added as a part of 2022.09 release. 

• The ‘RDBMS Table’ widget is closed saving the widget data.
• The user is navigated to the FDR session page.

• Click the ‘Reconciliations’ tab.

• From the ‘Reconciliations’ tab, let’s drag and drop the ‘Map source & target fields’ icon.

Note: The ‘Map source & target fields’ icon gets disabled as the user drags it on to FDR session page.

• Click the ‘Map source & target fields’ widget.

• A ‘Map source & target fields’ pop-up window is displayed.
• Click the ‘Save’ button.

• A ‘Confirm Action’ pop-up window is displayed.
• Click the ‘Verified’ button.

• The ‘Map source & target fields’ widget is closed saving the data.
• The user is navigated to the FDR session page.
• Now, let’s select the ‘Do Comparison on Source’ button.

• Click the ‘Do Comparison on Source’ button to enable the ‘Pushdown reconciliation’ feature.

Note: The ‘Do Comparison on Source’ button turns green indicating the ‘Pushdown reconciliation’ is successful.

• Click the ‘Execute Now’ button.

• The execution is ‘Errored’ here.
• The monitor mode is enabled immediately after the execution process.
• Click the ‘Map source & target fields’ widget ‘Error’ icon.

• The user is navigated to the ‘Functional Data Reconciliation Exceptions’ session page.