Functional Data Reconciliation using Data snapshot as source

You are viewing documentation for Data Trust v7.6 (latest).
Looking for the previous version? View v2024.06 documentation →

Data Trust › Scenario Studio › Scenario Builder

FDR using Data Snapshot as Source

Use a point-in-time data snapshot as the source in an FDR scenario.

Overview

This guide walks through the FDR using Data Snapshot as Source scenario in Data Trust Scenario Studio. Follow the numbered steps below to configure, execute, and review the results of this scenario type.

Note: Ensure all required connection profiles are configured in the Administration module before building this scenario.

Prerequisites

• You are logged in to Data Trust with a Pro-User or Admin Pro-User role.
• The relevant connection profiles have been configured in the Administration module.

Steps

Path: Data Trust › Scenario Studio › Scenario Builder › FDR using Data Snapshot as Source

Figure 1: Functional Data Recon Option

Navigate to the Scenario Studio module and select the FDR using Data Snapshot as Source option from the left sidebar or main menu. This opens the scenario builder canvas where you will configure the data source connections, transformation rules, and execution settings.

Figure 2: FDR Create Page

The FDR using Data Snapshot as Source create page is the starting point for building a new scenario. Provide a name for the scenario, choose the appropriate folder, and then proceed to configure data sources and execution logic on the canvas.

Figure 3: Drag and Query Chain widget

This step involves interacting with the Drag and Query Chain widget within the FDR using Data Snapshot as Source workflow. Follow the on-screen prompts to complete this step before proceeding to the next configuration stage.

Figure 4: Select Query Chain

This step involves selecting the Select Query Chain within the FDR using Data Snapshot as Source workflow. Follow the on-screen prompts to complete this step before proceeding to the next configuration stage.

Figure 5: Drag and drop Custom SQL Widget

Drag the Custom Sql Widget from the widget palette and drop it onto the scenario canvas. Positioning the widget opens its configuration popup where you will set the connection, table, and any additional options.

Figure 6: Select Traget connection and click on navigator

Select the appropriate connection from the dropdown to link this widget to its data source. Choosing the correct connection profile ensures the scenario reads from or writes to the intended database or file system.

Figure 7: Expand Navigator

The Navigator panel displays the available databases, schemas, and tables for the selected connection. Expand the tree to locate the required table or view, then click Select to add it to the widget configuration.

Figure 8: Select Table

The Navigator panel displays the available databases, schemas, and tables for the selected connection. Expand the tree to locate the required table or view, then click Select to add it to the widget configuration.

Figure 9: Metadata

Click Get Metadata to automatically retrieve the column structure and data types from the connected data source. Review the retrieved metadata and deselect any columns that are not relevant before proceeding to configure validation rules.

Figure 10: Drag and drop Aggregation Widget

Drag the Aggregation Widget from the widget palette and drop it onto the scenario canvas. Positioning the widget opens its configuration popup where you will set the connection, table, and any additional options.

Figure 11: Default All columns will select

This step involves interacting with the Default All columns will select within the FDR using Data Snapshot as Source workflow. Follow the on-screen prompts to complete this step before proceeding to the next configuration stage.

Figure 12: Apply Aggregation On Selected columns

This step involves interacting with the Apply Aggregation On Selected columns within the FDR using Data Snapshot as Source workflow. Follow the on-screen prompts to complete this step before proceeding to the next configuration stage.

Figure 13: Drag and drop Filter widget

Drag the Filter Widget from the widget palette and drop it onto the scenario canvas. Positioning the widget opens its configuration popup where you will set the connection, table, and any additional options.

Figure 14: Filter Popup

The Filter Popup dialog exposes all available configuration options for this step. Review each field carefully and fill in the required values before clicking Save or OK to apply the configuration.

Figure 15: Filter Experssion

The Filter Experssion panel allows you to define criteria that limit which records are included in the comparison. Filters reduce data volume and processing time by excluding records that are out of scope for this reconciliation or validation run.

Figure 16: Filter Saved

Click the Save button to persist the current widget or scenario configuration. A confirmation indicator appears on the canvas once the save is successful, and the widget thumbnail updates to reflect the configured state.

Figure 17: Drag and drop Recon widget

Drag the Recon Widget from the widget palette and drop it onto the scenario canvas. Positioning the widget opens its configuration popup where you will set the connection, table, and any additional options.

Figure 18: Recon popup

The Recon popup dialog exposes all available configuration options for this step. Review each field carefully and fill in the required values before clicking Save or OK to apply the configuration.

Figure 19: Confirm Action popup

The Confirm Action popup dialog exposes all available configuration options for this step. Review each field carefully and fill in the required values before clicking Save or OK to apply the configuration.

Figure 20: Additional Options Tab

Navigate to the Scenario Studio module and select the FDR using Data Snapshot as Source option from the left sidebar or main menu. This opens the scenario builder canvas where you will configure the data source connections, transformation rules, and execution settings.

Figure 21: Drag and drop Email Widget

Drag the Email Widget from the widget palette and drop it onto the scenario canvas. Positioning the widget opens its configuration popup where you will set the connection, table, and any additional options.

Figure 22: Configure Email and click on Save

Click the Save button to persist the current widget or scenario configuration. A confirmation indicator appears on the canvas once the save is successful, and the widget thumbnail updates to reflect the configured state.

Figure 23: Execute FDR

Click the Execute button to trigger the scenario and begin processing data from the configured sources. The scenario transitions to Monitor mode where you can track real-time execution progress and view interim results as each step completes.

Figure 24: Execution Completed

This step involves interacting with the Execution Completed within the FDR using Data Snapshot as Source workflow. Follow the on-screen prompts to complete this step before proceeding to the next configuration stage.

Figure 25: Scenario Execution Summary

The Scenario Execution Summary page presents the full outcome of the scenario execution including record counts, match rates, and any detected exceptions. Drill into exception records to inspect individual mismatches and use the Export to CSV option to share results with stakeholders.

Figure 26: Recived Emai

This step involves interacting with the Recived Emai within the FDR using Data Snapshot as Source workflow. Follow the on-screen prompts to complete this step before proceeding to the next configuration stage.