FDR using remote FTP (CSV) and Snowflake – RightData

You are viewing archived documentation for Data Trust v2024.06 (previous version).
Go to the latest v7.6 documentation →

FDR using remote FTP and Snowflake

Using FDR, users can compare a pair of data sets (source and target) to the field by field level and this option is the most comprehensive way to reconcile data between all RDt supported data sources. As a use case, let’s reconcile data using remote FTP and Snowflake.

To learn more, let us walk through the below procedure:

Click the SCENARIO STUDIO module.
Hover on the Scenario Builder snippet from the left pane options.
Click the Functional Data Recon option.

A new FDR session page is displayed.
From the Data Source tab, let’s drag and drop a CSV icon from the design palette and double-tap it.

A Read data from CSV file pop-up window is displayed.
By default, the Choose file from option is switched to Remote.
Provide the Remote file location path, User Name, and Password details.
Click the Test Connection button.

A “Test Connection Successful!” toaster message is displayed.
Different text field parameters such as Delimiter, Escape character, Skip Rows, Upto, Preview record count, First row as Header, Max Scan Rows, Date Format, Time Format, Time Stamp Format, Ignore Dirty Data, Parallelism, and Packet Size are populated.
Click the Preview Data and Confirm Metadata button.

A Preview metadata page is displayed.
Click the Select button.

This action saves the CSV widget.
From the Data Source tab, drag and drop RDBMS Table as a target and double-tap on it.

A Read data from Table pop-up window is displayed.
Select Database Type as Snowflake and Connection Name as SNOWFLAKE from available drop-down lists.
Click the Navigator.

A Navigator slide screen is displayed.
Select and click a table to add it under Pick Table.
Click the Select button to save the RDBMS Table widget.

Click the Reconciliations tab.

Drag and drop Map source & target fields icon onto the design canvas and double-tap it.

A Map source & target fields pop-up window is displayed.
Click on Save.

A Confirm action pop-up window is displayed.
Click the Verified button.

Click on the Execute Now icon.

Here the scenario is Failed.
Click on Map source & target fields exceptions count 31.

This action navigates to Functional Data Reconciliation Exceptions session page.