You are viewing documentation for Data Trust v7.6 (latest).
Looking for the previous version? View v2024.06 documentation →

Validation Scenario

Build a complete validation scenario to check data quality using business rules.

Overview

A Validation scenario applies business rule checks to a dataset to ensure it meets defined quality criteria. Rules include Duplicate Check, Null Check, Range, Pattern, Referential Integrity, and custom SQL-based rules. This guide walks through building a validation scenario from data source selection to execution.

Note: Ensure all required connection profiles are configured in the Administration module before building this scenario.

Prerequisites

You are logged in to Data Trust with a Pro-User or Admin Pro-User role.
At least one connection profile has been configured and the target table or query is accessible.

Steps

Path: Data Trust › Scenario Studio › Scenario Builder › Validation Scenario

Validation Option

Figure 1: Validation Option

Navigate to the Scenario Studio module and select the Validation Scenario option from the left sidebar or main menu. This opens the scenario builder canvas where you will configure the data source connections, transformation rules, and execution settings.

Supported Data Sources

Figure 2: Supported Data Sources

This step involves interacting with the Supported Data Sources within the Validation Scenario workflow. Follow the on-screen prompts to complete this step before proceeding to the next configuration stage.

Drag and drop RDBMS Widget

Figure 3: Drag and drop RDBMS Widget

Drag the Rdbms Widget from the widget palette and drop it onto the scenario canvas. Positioning the widget opens its configuration popup where you will set the connection, table, and any additional options.

RDBMS Popup Fields

Figure 4: RDBMS Popup Fields

The RDBMS Popup Fields dialog exposes all available configuration options for this step. Review each field carefully and fill in the required values before clicking Save or OK to apply the configuration.

Select Connection Name and click on Navigator

Figure 5: Select Connection Name and click on Navigator

Select the appropriate connection from the dropdown to link this widget to its data source. Choosing the correct connection profile ensures the scenario reads from or writes to the intended database or file system.

Additional Settings popup

Figure 6: Additional Settings popup

The Additional Settings popup dialog exposes all available configuration options for this step. Review each field carefully and fill in the required values before clicking Save or OK to apply the configuration.

Select Table

Figure 7: Select Table

The Navigator panel displays the available databases, schemas, and tables for the selected connection. Expand the tree to locate the required table or view, then click Select to add it to the widget configuration.

Click on Preview data

Figure 8: Click on Preview data

The Preview Data option fetches a sample of records from the selected table to verify the connection and column structure. Confirm that the correct columns and sample data are visible before closing the preview and saving the widget.

Preview Data Popup

Figure 9: Preview Data Popup

The Preview Data Popup dialog exposes all available configuration options for this step. Review each field carefully and fill in the required values before clicking Save or OK to apply the configuration.

Click on Select Button

Figure 10: Click on Select Button

This step involves clicking the Click on Select Button within the Validation Scenario workflow. Follow the on-screen prompts to complete this step before proceeding to the next configuration stage.

Click on Trasformations Tab

Figure 11: Click on Trasformations Tab

This step involves clicking the Click on Trasformations Tab within the Validation Scenario workflow. Follow the on-screen prompts to complete this step before proceeding to the next configuration stage.

Availeble Transformations

Figure 12: Availeble Transformations

The Transformations tab lists all available data transformation widgets including Filter, Derive, Aggregate, and Lookup. Add transformation widgets between data source and reconciliation or validation widgets to cleanse or reshape data before comparison.

Drag and Drop Filter Widget

Figure 13: Drag and Drop Filter Widget

Drag the Filter Widget from the widget palette and drop it onto the scenario canvas. Positioning the widget opens its configuration popup where you will set the connection, table, and any additional options.

Filter Popup

Figure 14: Filter Popup

The Filter Popup dialog exposes all available configuration options for this step. Review each field carefully and fill in the required values before clicking Save or OK to apply the configuration.

Filter Expression and Save

Figure 15: Filter Expression and Save

Click on Validation Rules Tab

Figure 16: Click on Validation Rules Tab

The Validation Rules tab lists all available business rule widgets that can be applied to the selected dataset. Drag the required rule widget onto the canvas, configure its threshold or pattern, then save before moving to the next step.

All Availeble Transformations

Figure 17: All Availeble Transformations

Drag and drop Duplicate Check rule

Figure 18: Drag and drop Duplicate Check rule

Drag the Duplicate Check Rule from the widget palette and drop it onto the scenario canvas. Positioning the widget opens its configuration popup where you will set the connection, table, and any additional options.

All Fields in the Duplicate Check widget fields

Figure 19: All Fields in the Duplicate Check widget fields

The All Fields in the Duplicate Check widget fields dialog exposes all available configuration options for this step. Review each field carefully and fill in the required values before clicking Save or OK to apply the configuration.

Filter Expression and Save it

Figure 20: Filter Expression and Save it

Click on Additional Options Tab

Figure 21: Click on Additional Options Tab

All Availeble Additional Options

Figure 22: All Availeble Additional Options

Drag and Drop Email widget

Figure 23: Drag and Drop Email widget

Drag the Email Widget from the widget palette and drop it onto the scenario canvas. Positioning the widget opens its configuration popup where you will set the connection, table, and any additional options.

All fields in Email Widget

Figure 24: All fields in Email Widget

The All fields in Email Widget dialog exposes all available configuration options for this step. Review each field carefully and fill in the required values before clicking Save or OK to apply the configuration.

Configure Email

Figure 25: Configure Email

The Email widget sends an automated result notification to configured recipients after the scenario finishes executing. Provide the recipient addresses, subject, and choose whether to attach the exception report or include a summary in the email body.

All Action Buttons in the Validation Create page

Figure 26: All Action Buttons in the Validation Create page

The Validation Scenario create page is the starting point for building a new scenario. Provide a name for the scenario, choose the appropriate folder, and then proceed to configure data sources and execution logic on the canvas.

Monitor Mode

Figure 27: Monitor Mode

Monitor mode displays the live execution status of the scenario with a progress indicator for each processing stage. Wait for all stages to reach a Completed or Passed state before navigating to the result summary to review the full output.

Validation Execution Summary Page

Figure 28: Validation Execution Summary Page

The Validation Execution Summary Page page presents the full outcome of the scenario execution including record counts, match rates, and any detected exceptions. Drill into exception records to inspect individual mismatches and use the Export to CSV option to share results with stakeholders.