Looking for the previous version? View v2024.06 documentation →
Query Chain Execution using De-Duplication Transformation
Overview
This guide walks through the Query Chain Execution using De-Duplication Transformation workflow in Data Trust Query Studio. Follow the numbered steps below to configure, execute, and review the results.
Prerequisites
- You are logged in to Data Trust with a Pro-User or Admin Pro-User role.
- The relevant connection profiles have been configured in the Administration module.
Steps
Path: Data Trust › Query Studio › Query Chain Execution using De-Duplication Transformation
Navigate to the Query Studio module and select Query Chin Option to open the Query Builder workspace. This is the starting point for creating, editing, and managing queries in Data Trust.
The Query Chain Create page is the main workspace for building and editing queries. Use the canvas to write SQL, add data sources, connect transformations, and configure output options.
Drag the Rdbms Widget widget from the palette and drop it onto the Query Chain canvas. Once placed, click the widget to open its configuration popup and complete the required settings.
This step shows RDBMS widget popup in the Query Chain Execution using De-Duplication Transformation workflow. Follow the on-screen prompts to complete this configuration step before proceeding to the next stage.
Navigate to the Query Studio module and select Navigator option to open the Query Builder workspace. This is the starting point for creating, editing, and managing queries in Data Trust.
The Navigator panel displays the available databases, schemas, and tables for the selected connection. Expand the tree to locate the required table, then click Select to add it to the query.
The Navigator panel displays the available databases, schemas, and tables for the selected connection. Expand the tree to locate the required table, then click Select to add it to the query.
The Preview Data button fetches a sample of records from the selected table or query result. Verify the column names and sample values before proceeding to confirm the data source is correctly configured.
This step shows Search column name in the Query Chain Execution using De-Duplication Transformation workflow. Follow the on-screen prompts to complete this configuration step before proceeding to the next stage.
Click Save to persist the query or configuration to the Query Explorer. A confirmation message appears once the save completes, and the query is available for reuse in Query Chains and scenarios.
Navigate to the Query Studio module and select Trasformations tab option to open the Query Builder workspace. This is the starting point for creating, editing, and managing queries in Data Trust.
Drag the De Dups Widget widget from the palette and drop it onto the Query Chain canvas. Once placed, click the widget to open its configuration popup and complete the required settings.
The De Dups widget popup transformation combines or deduplicates records from one or more input streams. Configure the matching columns and handling logic, then save the widget to apply the operation in the chain.
The Select columns in De Dups widget transformation combines or deduplicates records from one or more input streams. Configure the matching columns and handling logic, then save the widget to apply the operation in the chain.
Click Save to persist the query or configuration to the Query Explorer. A confirmation message appears once the save completes, and the query is available for reuse in Query Chains and scenarios.
Drag the Rd Output Widget widget from the palette and drop it onto the Query Chain canvas. Once placed, click the widget to open its configuration popup and complete the required settings.
The RD Output widget captures the final result set from the Query Chain for use in downstream processes. Configure the output name and format, then save the widget to make the results accessible to other scenarios and reports.
Click Execute Now to run the query immediately and fetch the result set. The results appear in the Results tab, and the execution status is displayed in the progress indicator.
Click Execute Now to run the query immediately and fetch the result set. The results appear in the Results tab, and the execution status is displayed in the progress indicator.
This step shows QC Result in the Query Chain Execution using De-Duplication Transformation workflow. Follow the on-screen prompts to complete this configuration step before proceeding to the next stage.
This step shows Column Level Search in the Query Chain Execution using De-Duplication Transformation workflow. Follow the on-screen prompts to complete this configuration step before proceeding to the next stage.