Filter data using variables in Query Chain

You are viewing Query Studio - Query Builder documentation for Data Trust v7.6 (latest).
Looking for the previous version? View v2024.06 documentation →

Data Trust › Query Studio › Query Builder

Filter Data using Variables in a Query Chain

Inject a user-defined variable into a Query Chain filter for dynamic data selection.

Overview

A Query Chain (QC) is a multi-step data pipeline built on the Query Studio canvas. It connects data source widgets (RDBMS, Query, REST API, CSV, etc.) through transformation widgets (Filter, Aggregation, Join, Pivot, Unpivot, Projection) to an RD Output or file export. Query Chains can be scheduled, emailed, and reused as inputs to scenarios.

Note: Ensure all required connection profiles are configured in the Administration module before building queries or Query Chains in this workflow.

Prerequisites

• You are logged in to Data Trust with a Pro-User or Admin Pro-User role.
• At least one connection profile and one saved query are available in the system.

Steps

Path: Data Trust › Query Studio › Filter Data using Variables in a Query Chain

Figure 1: Query Studio_Query Builder_Query Chain

Navigate to the Query Studio module and select Query Studio_Query Builder_Query Chain to open the Query Builder workspace. This is the starting point for creating, editing, and managing queries in Data Trust.

Figure 2: Query Chain create page

The Query Chain create page is the main workspace for building and editing queries. Use the canvas to write SQL, add data sources, connect transformations, and configure output options.

Figure 3: Read data from table widget

This step shows Read data from table widget in the Filter Data using Variables in a Query Chain workflow. Follow the on-screen prompts to complete this configuration step before proceeding to the next stage.

Figure 4: Read data from table_popup window

This step shows Read data from table_popup window in the Filter Data using Variables in a Query Chain workflow. Follow the on-screen prompts to complete this configuration step before proceeding to the next stage.

Figure 5: PostgreSQL_Database Type_PostgreSQL_Connection Name_Click the Navigator

Select the appropriate connection profile from the dropdown to link the query to its data source. Choosing the correct profile ensures the query reads from the intended database or system.

Figure 6: Navigator slide screen_is_ordes table from tpch1 schema

The Navigator panel displays the available databases, schemas, and tables for the selected connection. Expand the tree to locate the required table, then click Select to add it to the query.

Figure 7: Click is_orders table_Click Select button

This step shows Click is_orders table_Click Select button in the Filter Data using Variables in a Query Chain workflow. Follow the on-screen prompts to complete this configuration step before proceeding to the next stage.

Figure 8: Click the Transformations tab

The Transformations tab lists all available data transformation widgets — Filter, Projection, Aggregation, Join, Pivot, Unpivot, and more. Drag the required transformation onto the canvas and connect it between the data source and output widgets.

Figure 9: Drag and Drop the Filter transformation

The Filter transformation restricts the records passing through the Query Chain to only those matching the specified conditions. Define the filter expression using field dropdowns, operator selectors, and value inputs, then save the widget.

Figure 10: Filter data from Data Source popup window

The Filter transformation restricts the records passing through the Query Chain to only those matching the specified conditions. Define the filter expression using field dropdowns, operator selectors, and value inputs, then save the widget.

Figure 11: Drag the available fields and available operators_employeeid_equals to

Drag the The Available Fields And Available Operators_Employeeid_Equals To widget from the palette and drop it onto the Query Chain canvas. Once placed, click the widget to open its configuration popup and complete the required settings.

Figure 12: Variables window popup_Predefined variables tab_Click the User defined tab

The Variables panel lists all predefined system variables and user-defined variables available for use in queries. Select a variable to insert it into the query expression, making the query dynamic and reusable across executions.

Figure 13: Select the checkbox_USR_employeeid_Click the Test Result

This step shows Select the checkbox_USR_employeeid_Click the Test Result in the Filter Data using Variables in a Query Chain workflow. Follow the on-screen prompts to complete this configuration step before proceeding to the next stage.

Figure 14: Action loads the variable (3) under the ‘Result’ field_Click on Ok

The Variables panel lists all predefined system variables and user-defined variables available for use in queries. Select a variable to insert it into the query expression, making the query dynamic and reusable across executions.

Figure 15: Expression field_Click the Save button

Click Save to persist the query or configuration to the Query Explorer. A confirmation message appears once the save completes, and the query is available for reuse in Query Chains and scenarios.

Figure 16: Click the Output tab

The RD Output widget captures the final result set from the Query Chain for use in downstream processes. Configure the output name and format, then save the widget to make the results accessible to other scenarios and reports.

Figure 17: Drag and Drop_RD Output icon

Drag the _Rd Output Icon widget from the palette and drop it onto the Query Chain canvas. Once placed, click the widget to open its configuration popup and complete the required settings.

Figure 18: RD Output popup_Click the Select button

The RD Output widget captures the final result set from the Query Chain for use in downstream processes. Configure the output name and format, then save the widget to make the results accessible to other scenarios and reports.

Figure 19: Click the Execute Now button

Click Execute Now to run the query immediately and fetch the result set. The results appear in the Results tab, and the execution status is displayed in the progress indicator.

Figure 20: Click the RD Output count icon

The RD Output widget captures the final result set from the Query Chain for use in downstream processes. Configure the output name and format, then save the widget to make the results accessible to other scenarios and reports.

Figure 21: Results tab displaying the executed filtered data using variable

The Variables panel lists all predefined system variables and user-defined variables available for use in queries. Select a variable to insert it into the query expression, making the query dynamic and reusable across executions.