You are viewing Query Studio - Query Builder documentation for Data Trust v7.6 (latest).
Looking for the previous version? View v2024.06 documentation →

Data Trust › Query Studio › Query Builder

Query Chain Execution using Union Transformation

Combine multiple data streams into one using the Union transformation in a Query Chain.

Overview

The Union transformation in a Query Chain combines records from two or more data streams into a single output, stacking rows vertically. This guide covers configuring a Union transformation with matching column schemas.

Note: Ensure all required connection profiles are configured in the Administration module before building queries or Query Chains in this workflow.

Prerequisites

• You are logged in to Data Trust with a Pro-User or Admin Pro-User role.
• A Query Chain with at least two data source widgets has been configured.

Steps

Path: Data Trust › Query Studio › Query Chain Execution using Union Transformation

Figure 1: Query Studio-Query Chain

Navigate to the Query Studio module and select Query Studio-Query Chain to open the Query Builder workspace. This is the starting point for creating, editing, and managing queries in Data Trust.

Figure 2: Drag and Dop RDBMS widget from Query Chain create page

The Drag and Dop RDBMS widget from Query Chain create page is the main workspace for building and editing queries. Use the canvas to write SQL, add data sources, connect transformations, and configure output options.

Figure 3: Database Type_Connection Name_Click the Navigator

Select the appropriate connection profile from the dropdown to link the query to its data source. Choosing the correct profile ensures the query reads from the intended database or system.

Figure 4: Billing_Summary_Fact table from the Healthcare_DB schema

The Billing_Summary_Fact table from the Healthcare_DB schema panel manages the compute instances and processor configurations used for Query Chain execution. Configure Databricks or other processor types to enable distributed or push-down query execution for large datasets.

Figure 5: Billing_Summary_Fact table-Click the Select button schema

The Billing_Summary_Fact table-Click the Select button schema panel manages the compute instances and processor configurations used for Query Chain execution. Configure Databricks or other processor types to enable distributed or push-down query execution for large datasets.

Figure 6: Click the Transformation tab

The Transformations tab lists all available data transformation widgets — Filter, Projection, Aggregation, Join, Pivot, Unpivot, and more. Drag the required transformation onto the canvas and connect it between the data source and output widgets.

Figure 7: Drag and Drop the Union widget

Drag the The Union Widget widget from the palette and drop it onto the Query Chain canvas. Once placed, click the widget to open its configuration popup and complete the required settings.

Figure 8: Drag and Drop the RDBMS widget from the Data Sources tab

Drag the The Rdbms Widget From The Data Sources Tab widget from the palette and drop it onto the Query Chain canvas. Once placed, click the widget to open its configuration popup and complete the required settings.

Figure 9: Database Type_Connection Name_Click the Navigator

Select the appropriate connection profile from the dropdown to link the query to its data source. Choosing the correct profile ensures the query reads from the intended database or system.

Figure 10: Billing_Summary_Fact table-Healthcare_DB_Gold schema

The Billing_Summary_Fact table-Healthcare_DB_Gold schema panel manages the compute instances and processor configurations used for Query Chain execution. Configure Databricks or other processor types to enable distributed or push-down query execution for large datasets.

Figure 11: Adding the pick table and Click the Select button

This step shows Adding the pick table and Click the Select button in the Query Chain Execution using Union Transformation workflow. Follow the on-screen prompts to complete this configuration step before proceeding to the next stage.

Figure 12: Save the RDBMS widget

Click Save to persist the query or configuration to the Query Explorer. A confirmation message appears once the save completes, and the query is available for reuse in Query Chains and scenarios.

Figure 13: Join the RDBMS table widgets to Union transformation widget

The Join widget merges two data streams based on matching key columns, similar to a SQL JOIN operation. Select the join type (Inner, Left, Right, or Full) and map the key columns from both input streams.

Figure 14: Check the Remove duplicates option and Click the Select button

Navigate to the Query Studio module and select Check the Remove duplicates option and Click the Select button to open the Query Builder workspace. This is the starting point for creating, editing, and managing queries in Data Trust.

Figure 15: Saving the Union Datasets widget and Click the Output tab

The RD Output widget captures the final result set from the Query Chain for use in downstream processes. Configure the output name and format, then save the widget to make the results accessible to other scenarios and reports.

Figure 16: Drag and Drop the RD Output widget and double tap on RD Output widget

Drag the The Rd Output Widget And Double Tap On Rd Output Widget widget from the palette and drop it onto the Query Chain canvas. Once placed, click the widget to open its configuration popup and complete the required settings.

Figure 17: RD Output popup-Click the Select button

The RD Output widget captures the final result set from the Query Chain for use in downstream processes. Configure the output name and format, then save the widget to make the results accessible to other scenarios and reports.

Figure 18: Saving the RD Output widget and Click the Execute Now button

Click Execute Now to run the query immediately and fetch the result set. The results appear in the Results tab, and the execution status is displayed in the progress indicator.

Figure 19: Query Chain executed_Monitor mode is enabled_Click the RD Output Count icon

Click Execute Now to run the query immediately and fetch the result set. The results appear in the Results tab, and the execution status is displayed in the progress indicator.

Figure 20: Executed Results tab data

Click Execute Now to run the query immediately and fetch the result set. The results appear in the Results tab, and the execution status is displayed in the progress indicator.