Skip to main content

FDR using remote shared drive (CSV) and Snowflake

You are viewing archived documentation for Data Trust v2024.06 (previous version).
Go to the latest v7.6 documentation →

FDR using remote shared drive and Snowflake

Using FDR, users can compare a pair of data sets (source and target) to the field by field level and this option is the most comprehensive way to reconcile data between all RDt supported data sources. As a use case, let’s reconcile data using remote shared drive and Snowflake.

To learn more, let us walk through the below procedure:

  • Click the SCENARIO STUDIO module.
  • Hover on the Scenario Builder snippet from the left pane options.
  • Click the Functional Data Recon option.

  • A new FDR session page is displayed.
  • From the Data Source tab, let’s drag and drop a CSV icon from the design palette and double-tap it.

C

  • A Read data from CSV file pop-up window is displayed.
  • By default, the Choose file from option is switched to Remote.
  • Checkbox the Shared Drive option.

  • Provide the Remote File “Shared Drive” path.

Note: Checking the Shared Drive option populates different text field options such as User Name, Password, Delimiter, Escape character, Skip Rows, Upto, Preview record count, First row as Header, Max Scan Rows, Date Format, Time Format, Time Stamp Format, Ignore Dirty Data, Parallelism, and Packet Size.

  • Click the Preview Data and Confirm Metadata button.

  • A Preview metadata page is displayed.
  • Click the Select button.

  • This action saves the CSV widget.
  • From the Data Source tab, drag and drop RDBMS Table as a target and double-tap on it.

  • A Read data from Table pop-up window is displayed.
  • Select Database Type as Snowflake and Connection Name as SNOWFLAKE from available drop-down lists.
  • Click the Navigator.

  • A Navigator slide screen is displayed.
  • Select and click a table to add it under Pick Table.
  • Click the Select button to save the RDBMS Table widget.

  • Click the Reconciliations tab.

  • Drag and drop Map source & target fields icon onto the design canvas and double-tap it.

  • A Map source & target fields pop-up window is displayed.
  • Click on Save.

  • A Confirm action pop-up window is displayed.
  • Click the Verified button.

  • Click on the Execute Now icon.

  • Here the scenario is Failed.
  • Click on Map source & target fields exceptions count 31.

  • This action navigates to Functional Data Reconciliation Exceptions session page.

\\EC2AMAZ-GUUIB14\\test_shared_folder\\ORDERS.csv

Was this article helpful?