Query Chain execution using De Dups transformation

You are viewing archived documentation for Data Trust v2024.06 (previous version).
Go to the latest v7.6 documentation →

Query Chain execution using De Dups transformation

Query Chain is a part of the QUERY STUDIO module. A Query Chain runs and executes data using different profiles. Let’s execute Query Chain using ‘De Dups’ transformation to remove Duplicate data from column(s).

To learn more, let us walk through the below procedure:

• Click the ‘Query Studio’ module.
• Hover on the ‘Query Builder’ snippet.
• Click the ‘Query Chain’ option.

• The user is navigated to the new Query Chain session page.

• From the ‘Data Source’ tab, let’s drag and drop an ‘RDBMS Table’ icon onto Query Chain create and edit page.

Note: All other Data Source icons including ‘RDBMS Table’ gets disabled as the user drags it onto Query Chain session page.

• Double tap the ‘Read data from Table’ widget.

• A ‘Read data from table’ pop-up window is displayed.

• Let’s select ‘Redshift’ from ‘Database Type’ drop-down list and ‘Redshift-QA_AWS’ from ‘Connection Name’ drop-down list.
• Click the ‘Click here for Navigator’ button.

• A ‘Navigator’ slide screen is displayed on the right side of the page.
• Let’s select the ‘order_details’ table from the ‘Public’ schema.

• Click the ‘order_details’ table to pick the table.
• Click the ‘Preview Data’ button.

• A ‘Data for public.order_details’ pop-up window is displayed.

• Let’s add ‘10’ under the ‘quantity’ column search text field.

Note: This action displays five times ‘10’ duplicated data.

• Click the ‘X’ button.

• This action closes the ‘Data for public.order_details’ pop-up window.
• The user is navigated to ‘Read data from “public.orders’ for data source’ pop-up window.
• Click the ‘Select’ button.

• This action saves the ‘RDBMS table’ widget data by closing it.
• The user is navigated to the Query Chain session page.
• Click the ‘Transformations’ tab.

• Let’s drag and drop ‘De Dups’ icon onto the Query Chain session page.
• Double tap the ‘Remove duplicates from selected columns’ widget.

• A ‘Remove duplicates from selected columns’ pop-up window is displayed.

Note: By default, all the Column Names are selected.

• Let’s select ‘quantity’ from the ‘Column Name.’
• Click the ‘Save’ button.

• This action closes the ‘De-dups’ widget saving its data.
• The user is navigated to the ‘Query Chain’ session page.
• Click the ‘Output’ tab.

• Let’s drag and drop an ‘RD Output’ icon.
• Double tap the ‘RD Output’ widget.

• An ‘RD Output’ pop-up window is displayed.
• Click the ‘Select’ button.

• This action closes the ‘RD Output’ widget data by closing it.
• Click the ‘Execute Now’ button.

• A green color tick mark indicates the Query Chain is executed successfully.
• A monitor mode is enabled.
• Let’s click on the ‘RD Output’ count icon (57).

• This action navigates the user to the ‘Results’ tab displaying all the remaining data after duplicates removal.

• Let’s search by adding the number ‘10’ to the ‘quantity’ column.

Note: The duplicated data ‘10’ is removed from the ‘Result’ snapshot data.