You are viewing Query Studio - Query Builder documentation for Data Trust v7.6 (latest).
Looking for the previous version? View v2024.06 documentation →

Data Trust › Query Studio › Query Builder

Query Chain

Build multi-step data pipelines connecting sources, transformations, and outputs.

Overview

A Query Chain (QC) is a multi-step data pipeline built on the Query Studio canvas. It connects data source widgets (RDBMS, Query, REST API, CSV, etc.) through transformation widgets (Filter, Aggregation, Join, Pivot, Unpivot, Projection) to an RD Output or file export. Query Chains can be scheduled, emailed, and reused as inputs to scenarios.

Note: Ensure all required connection profiles are configured in the Administration module before building queries or Query Chains in this workflow.

Prerequisites

• You are logged in to Data Trust with a Pro-User or Admin Pro-User role.
• At least one connection profile and one saved query are available in the system.

Steps

Path: Data Trust › Query Studio › Query Chain

Figure 1: QC_navigation

Navigate to the Query Studio module and select QC_navigation to open the Query Builder workspace. This is the starting point for creating, editing, and managing queries in Data Trust.

Figure 2: Qc page

The Qc page is the main workspace for building and editing queries. Use the canvas to write SQL, add data sources, connect transformations, and configure output options.

Figure 3: QC_Hedaer widget

This step shows QC_Hedaer widget in the Query Chain workflow. Follow the on-screen prompts to complete this configuration step before proceeding to the next stage.

Figure 4: QC_Header widget_folders button

The QC_Header widget_folders button option creates a copy or moves the selected query or folder within the Query Explorer hierarchy. Use this to duplicate a query as a starting point for a new one, or to reorganise the folder structure.

Figure 5: QC_Chosse folder_new folder button

The QC_Chosse folder_new folder button option creates a copy or moves the selected query or folder within the Query Explorer hierarchy. Use this to duplicate a query as a starting point for a new one, or to reorganise the folder structure.

Figure 6: QC_Chosse folder_new folder _add folder pop up

The QC_Chosse folder_new folder _add folder pop up option creates a copy or moves the selected query or folder within the Query Explorer hierarchy. Use this to duplicate a query as a starting point for a new one, or to reorganise the folder structure.

Figure 7: QC_added folder

The QC_added folder option creates a copy or moves the selected query or folder within the Query Explorer hierarchy. Use this to duplicate a query as a starting point for a new one, or to reorganise the folder structure.

Figure 8: QC page_return to explorer

The QC page_return to explorer is the main workspace for building and editing queries. Use the canvas to write SQL, add data sources, connect transformations, and configure output options.

Figure 9: QC_Explorer navigation

Navigate to the Query Studio module and select QC_Explorer navigation to open the Query Builder workspace. This is the starting point for creating, editing, and managing queries in Data Trust.

Figure 10: QC_where used list button

The QC_where used list button panel shows all Query Chains, scenarios, and other artefacts that reference the selected query. Use this to assess the impact of modifying a query before making changes that could affect dependent processes.

Figure 11: QC_where used list button

The QC_where used list button panel shows all Query Chains, scenarios, and other artefacts that reference the selected query. Use this to assess the impact of modifying a query before making changes that could affect dependent processes.

Figure 12: QC_Draggged RDBMS table

Drag the Qc_Gged Rdbms Table widget from the palette and drop it onto the Query Chain canvas. Once placed, click the widget to open its configuration popup and complete the required settings.

Figure 13: Qc_Rdbms_pop up

This step shows Qc_Rdbms_pop up in the Query Chain workflow. Follow the on-screen prompts to complete this configuration step before proceeding to the next stage.

Figure 14: QC_RDBMS_Additional settings

The Additional Settings panel provides advanced configuration options such as custom aliases, timeout limits, and execution flags. Configure only the settings relevant to your use case and leave optional fields at their defaults.

Figure 15: QC_RDBMS_Additional setting pop up

The Additional Settings panel provides advanced configuration options such as custom aliases, timeout limits, and execution flags. Configure only the settings relevant to your use case and leave optional fields at their defaults.

Figure 16: QC_RDBMS_navigator

The Navigator panel displays the available databases, schemas, and tables for the selected connection. Expand the tree to locate the required table, then click Select to add it to the query.

Figure 17: QC_RDBMS_Selected table

The Navigator panel displays the available databases, schemas, and tables for the selected connection. Expand the tree to locate the required table, then click Select to add it to the query.

Figure 18: QC_RDBMS_Preview data

The Preview Data button fetches a sample of records from the selected table or query result. Verify the column names and sample values before proceeding to confirm the data source is correctly configured.

Figure 19: QC_RDBMSselect buttton _

This step shows QC_RDBMSselect buttton _ in the Query Chain workflow. Follow the on-screen prompts to complete this configuration step before proceeding to the next stage.

Figure 20: QC_RDBMS table selected

This step shows QC_RDBMS table selected in the Query Chain workflow. Follow the on-screen prompts to complete this configuration step before proceeding to the next stage.

Figure 21: QC_Transformations tab

The Transformations tab lists all available data transformation widgets — Filter, Projection, Aggregation, Join, Pivot, Unpivot, and more. Drag the required transformation onto the canvas and connect it between the data source and output widgets.

Figure 22: QC_Transformations_Filter widget

The Filter transformation restricts the records passing through the Query Chain to only those matching the specified conditions. Define the filter expression using field dropdowns, operator selectors, and value inputs, then save the widget.

Figure 23: QC_RDBMS_Filter pop up

The Filter transformation restricts the records passing through the Query Chain to only those matching the specified conditions. Define the filter expression using field dropdowns, operator selectors, and value inputs, then save the widget.

Figure 24: QC_RDBMS_Filter pop up_dragged fields

The Filter transformation restricts the records passing through the Query Chain to only those matching the specified conditions. Define the filter expression using field dropdowns, operator selectors, and value inputs, then save the widget.

Figure 25: QC_Filter_fileds drop down

The Filter transformation restricts the records passing through the Query Chain to only those matching the specified conditions. Define the filter expression using field dropdowns, operator selectors, and value inputs, then save the widget.

Figure 26: QC_RDBMS_Filter_operators dropdown

The Filter transformation restricts the records passing through the Query Chain to only those matching the specified conditions. Define the filter expression using field dropdowns, operator selectors, and value inputs, then save the widget.

Figure 27: QC_RDBMS_Filter

The Filter transformation restricts the records passing through the Query Chain to only those matching the specified conditions. Define the filter expression using field dropdowns, operator selectors, and value inputs, then save the widget.

Figure 28: QC_RDBMS Filter_Saved pop up

Click Save to persist the query or configuration to the Query Explorer. A confirmation message appears once the save completes, and the query is available for reuse in Query Chains and scenarios.

Figure 29: QC_RDBMS_Filter_Outout tab

The Filter transformation restricts the records passing through the Query Chain to only those matching the specified conditions. Define the filter expression using field dropdowns, operator selectors, and value inputs, then save the widget.

Figure 30: QC_RDBMS_RD output widget

The RD Output widget captures the final result set from the Query Chain for use in downstream processes. Configure the output name and format, then save the widget to make the results accessible to other scenarios and reports.

Figure 31: QC_RDBMS_Rd output pop up

The RD Output widget captures the final result set from the Query Chain for use in downstream processes. Configure the output name and format, then save the widget to make the results accessible to other scenarios and reports.

Figure 32: QC_Duplicate Qc

The QC_Duplicate Qc transformation combines or deduplicates records from one or more input streams. Configure the matching columns and handling logic, then save the widget to apply the operation in the chain.

Figure 33: QC_Additional options tab

Navigate to the Query Studio module and select QC_Additional options tab to open the Query Builder workspace. This is the starting point for creating, editing, and managing queries in Data Trust.

Figure 34: QC_Dragged Email widget

Drag the Qc_Ged Email Widget widget from the palette and drop it onto the Query Chain canvas. Once placed, click the widget to open its configuration popup and complete the required settings.

Figure 35: QC_Email pop up

The Email widget sends an automated notification with the Query Chain execution results to the specified recipients. Configure the recipient addresses, subject line, and result attachment options, then save before executing.

Figure 36: QC_Email_Save_Execute button

Click Execute Now to run the query immediately and fetch the result set. The results appear in the Results tab, and the execution status is displayed in the progress indicator.

Figure 37: QC_Execute now_dropdown

Click Execute Now to run the query immediately and fetch the result set. The results appear in the Results tab, and the execution status is displayed in the progress indicator.

Figure 38: QC_enbaled monitor mode

Monitor mode shows the live execution progress of the Query Chain as each widget processes data sequentially. Watch the progress indicators to confirm all stages complete successfully before reviewing the output.

Figure 39: QC_results

The QC_results displays the output data returned by the query or Query Chain execution. Review row counts, column values, and data quality before saving or using the output in downstream processes.

Figure 40: QC_Received emial

This step shows QC_Received emial in the Query Chain workflow. Follow the on-screen prompts to complete this configuration step before proceeding to the next stage.