Query Chain

You are viewing archived documentation for Data Trust v2024.06 (previous version).
Go to the latest v7.6 documentation →

Query Chain

Query Chain is a part of the QUERY STUDIO module. A Query Chain runs and executes data using different profiles. A Transformation tab transforms the data. The transformed data is loaded to an Output tab. Users can also send the executed Query Chain data to the desired email address through an Email widget from the additional options tab.

To learn about ‘Query Chain’, let us walk through the below procedure:

• Click the ‘QUERY STUDIO’ tab.
• Hover on the ‘Query Builder’ snippet from the left pane options.
• Click the ‘Query Chain’ option.

Note: Users can either click the ‘Query Chain’ option or ‘New Query Chain’ button to open a new Query Chain in create and edit mode.

Path01: QUERY STUDIO > Query Builder > Query Chain

Path 02: QUERY STUDIO > New Query Chain

• A New ‘Query Chain’ session page is displayed in create and edit mode.
• From the ‘Data Source’ tab, the user can view different data source options such as Queries, RD Database, Custom SQL, RDBMS Table, SAP Table, SAP Lite, SAP Infoprovider, Reconciliation Output, Qlik, Profiling, BW Extractor, Meta Data, CSV, JSON, Rest API, Sales Force, PowerBI, Fixed Width, XML, PDF, Tableau, and SOAP API.
• Three-button icons namely Create New, Return to Explorer, and Where Used List is displayed.
• Click the ‘Create New’ button.

• The user is navigated to the new ‘Query Chain’ session page.
• Click the header widget (RDAdmin 2/4/2022 5:28:42 AM).

• An ‘RDAdmin 2/4/2022 5:28:42 AM’ pop-up window is displayed.

Note: By default, the header widget name is taken as the ‘Query Chain Name’ and ‘Description’ text fields. The user can also modify these text field options if required.

• By default, ‘Retain data only for the last 2 Days’ is displayed for the ‘Data Retention’.

Note: The user can also change the ‘Data Retention’ settings from here.

• Click the ‘Browse Folders’ button option.

• A ‘Choose Folder’ pop-up window is displayed.
• The user can choose the specific folder from the ‘Root’ path here.
• Let’s, click the ‘Add New Folder’ button.

• An ‘Add Folder’ pop-up window is displayed.
• Let’s add ‘RDAdmin’ under the ‘Name’ text field.
• Click the ‘Add’ button.

• This action adds the ‘RDAdmin’ folder under the ‘Root’ path.
• Click the ‘X’ button from the right corner of the page and navigate back to the ‘Query Chain’ session page.

• Click the ‘Return to Explorer’ button.

• This action navigates the user to the ‘Query Explorer’ session page.
• Close this window and navigate back to the main ‘Query Chain’ session page.

• Click the ‘Where Used List’ button.

• A ‘Where Used List’ pop-up window is displayed.
• Close this window and navigate back to the main ‘Query Chain’ session page.

• Let’s suppose, from the ‘Data Source’ tab, drag and drop an ‘RDBMS Table’ widget as shown here.

Note: The user can select and drag any one Data Source from the ‘Data Source’ tab

• Click the RDBMS Table widget.

Note: The ‘RDBMS Table’ widget is disabled immediately as the user drags it on to Query Chain create and edit page.

• A ‘Read data from Table’ pop-up window is displayed.
• A ‘Database Type’ and ‘Connection Name’ drop-down lists are displayed.
• The users can ‘Pick Table’ through a ‘Navigator’ button option.

Note: By default, the ‘Pick Table’ field option is disabled but when the user selects the ‘Database Type’ and ‘Connection Name’ from the drop-down list, the ‘Pick Table’ field option will be enabled.

• Let’s suppose, select ‘PostgreSQL’ as ‘Database Type’ and ‘Connection Name’ as ‘Northwind PostgreSQL’
• A green tick mark appears beside the ‘Northwind PostgreSQL’ indicating the ‘Connection Name’ selection is successful.
• An ‘Additional Settings’ button is displayed beside the green tick mark.
• Click the ‘Additional Settings’ button.

• An ‘Additional Settings’ pop-up window is displayed with different text field options such as Parallelism, Packet Size, and Packetize By.

Note: By default, Parallelism is set to ‘1’ and Packet Size to ‘50000’.

• A ‘Reset to Default’ button is available if the user wants to reset ‘Parallelism’ and ‘Packet Size’ to default values.
• When hovered on the ‘info’ button on the ‘Additional Settings’ the user is assisted with information.
• Clicking the ‘Save’ button saves the ‘Additional Settings’.
• The moment the settings are saved the ‘Additional Settings’ pop-up window is closed and the user is navigated back to the ‘Read data from Table’ window.

• Click the ‘Navigator’ button pop-ups a ‘Navigator’ slide screen on the right-hand side.
• A ‘Refresh’ button is used to refresh the ‘Navigator’ session page.
• The ‘Navigator’ displays the Schemas and Tables.

• Let’s suppose click the plus ‘(+) bank details from the ‘Tables’ table.

Path: Northwind PostgreSQL > Public > Tables> bank details

• The ‘Pick Table’ displays the ‘public.bankdetails table selected from the tabular grid.
• Click the ‘Preview Data’ button.

• An ‘Existing Query’ pop-up window is displayed.
• Close the ‘window and navigate back to the ‘Read data from Table’ window.

• Click the ‘Select’ button.

• The user is navigated to the main ‘Query Chain’ session page saving and closing the ‘RDBMS Table’ widget.

• Clicking the ‘Transformations’ tab displays various Transformation options such as Projection, Aggregation, Filters, De Dups, Pivot, Un Pivot, Join, Union, and Fuzzy Lookup.

• Let’s suppose, on the ‘Transformations’ tab, drag and drop the ‘Filters’ option.
• Click the ‘Filters’ widget.

• A ‘Filter data from Data Source’ pop-up window is displayed.
• Within the Filter session, Available Fields, Available Operators, input, and add variables options are displayed.
• Below the ‘Filter’ session, an ‘Expression’ session with an ‘Edit Expression’ button preference is displayed.

• Let’s suppose, drag the Available Fields, Available Operators, and input.
• Click the ‘Select’ drop-down list from the ‘Available Fields’ filter.

• The different columns from the ‘RDBMS Table’ widget data are displayed.
• Let’s select ‘paymentsource’ option from the Select drop-down list under the Available Fields tab.
• Then, click the ‘Select’ drop-down list under the ‘Available Operators’ tab.

• The functions such as Equals to, Not equals to, Greater than, Greater than or equals to, Less than, Less than or equals to, Like, Between, Not between, AND, OR, Is null, Is null not, and IN are displayed.
• Let’s, select the ‘Less than or equals to’ option from the Select drop-down list under ‘Available Operators’ tab.

• Let’s add a value of ‘100000’ in the name field under ‘input’ tab.
• The user can notice the ‘Expression’ field is updated according to the Filter’ condition.
• Click the ‘Save’ button.

• The ‘Filter data from Data Source’ pop-up window is closed saving the ‘Filters’ widget condition.
• The user is navigated to the main ‘Query Chain’ create and edit mode.

• Clicking the Output tab displays three icons namely RD Output, Data Profiling, and Offload File.

• Now from the ‘Output’ tab, drag and drop the ‘RD Output’ widget.
• Click the ‘RD Output’ widget.

Note: The ‘RD Output’ icon gets disabled as the user drags it onto the ‘Query Chain’ create and edit page.

• An ‘RD Output’ pop-up window is displayed showing different details such as Data Snapshot, RD Database Name, Table Name, and Latest Output View Name.
• Click the ‘Select’ button.

• The ‘RD Output’ pop-up window is closed saving data.
• The user is navigated to the ‘Query Chain’ session page.

Note: A ‘Duplicate QueryChain’ button is enabled. Using this button, a user can duplicate this Query Chain.

• Clicking the ‘Additional Options’ tab displays the ‘Email’ icon.

• Let’s drag the ‘Email’ icon on to ‘Query chain create and edit page.

Note: The ‘Email’ icon gets disabled immediately as the user drags it onto the Query Chain session page.

• Click the ‘Email Settings’ widget.

• An ‘Email Settings’ pop-up window is displayed with different checkboxes and text field options.
• Checking ‘Generate Result File and Include Download Link’ sends the result file with a download link to the specified email address.
• Checking ‘Generate Pdf File and Include Attachment’ generates the result PDF file as an attachment.
• Similarly, the user can add the subject in the ‘Email Subject’ text field, enter ‘from name’ in the ‘Email From’ text field, select Email Priority (Normal, Low, or High) from the ‘Email Priority’ drop-down list, and email template from the ‘Email Template’ drop-down list.

Note: By default, ‘Normal’ Email Priority and ‘Default’ ‘Email Template’ are selected.

• Let’s add an email address in the ‘Email the execution status of the query’ text field.

Note: The email is greyed out due to confidential data.

• Click the ‘Save’ button.

• The ‘Email Settings’ pop-up window is closed and the user is navigated to the ‘Query Chain’ session page.
• Click the ‘Execute Now’ drop-down list.

• Two options namely ‘Execute Now’ and ‘Execute with run-time parameters’ are displayed.
• Let’s select the ‘Execute Now’ option.

• The execution process is successful and a green tick mark appears on the top right corner of the console.
• A Monitor mode is enabled immediately after the execution process.
• Click the count number from the ‘RD Output’ widget.

• The user is navigated to the ‘Result’ tab showing the Query Chain ‘RD Output’ execution result details.

• The user receives the ‘Query Execution’ results email as shown here.