Looking for the previous version? View v2024.06 documentation →
FDR using Remote Shared Drive (CSV) and Snowflake
Overview
This guide demonstrates an FDR scenario using a remote shared drive CSV file as the source and Snowflake as the target. The shared drive adapter reads the CSV and reconciles it against the Snowflake dataset.
Prerequisites
- You are logged in to Data Trust with a Pro-User or Admin Pro-User role.
- A shared drive connection profile and a Snowflake connection profile have been configured.
Steps
Path: Data Trust › Scenario Studio › Scenario Builder › FDR using Remote Shared Drive (CSV) and Snowflake
Navigate to the Scenario Studio module and select the FDR using Remote Shared Drive (CSV) and Snowflake option from the left sidebar or main menu. This opens the scenario builder canvas where you will configure the data source connections, transformation rules, and execution settings.
This step involves interacting with the FDR_Dragged CVS widget within the FDR using Remote Shared Drive (CSV) and Snowflake workflow. Follow the on-screen prompts to complete this step before proceeding to the next configuration stage.
The Read data from CSV pop up dialog exposes all available configuration options for this step. Review each field carefully and fill in the required values before clicking Save or OK to apply the configuration.
This step involves interacting with the Shareddrive file within the FDR using Remote Shared Drive (CSV) and Snowflake workflow. Follow the on-screen prompts to complete this step before proceeding to the next configuration stage.
The Preview data popup dialog exposes all available configuration options for this step. Review each field carefully and fill in the required values before clicking Save or OK to apply the configuration.
This step involves interacting with the Drag RDBMS widget within the FDR using Remote Shared Drive (CSV) and Snowflake workflow. Follow the on-screen prompts to complete this step before proceeding to the next configuration stage.
The Read data rom RDBMS pop up dialog exposes all available configuration options for this step. Review each field carefully and fill in the required values before clicking Save or OK to apply the configuration.
This step involves interacting with the RDBMS_data within the FDR using Remote Shared Drive (CSV) and Snowflake workflow. Follow the on-screen prompts to complete this step before proceeding to the next configuration stage.
This step involves interacting with the FDR_Source and target selected within the FDR using Remote Shared Drive (CSV) and Snowflake workflow. Follow the on-screen prompts to complete this step before proceeding to the next configuration stage.
The Reconciliation widget maps source fields to target fields for comparison. Use Smart Mapping to automatically propose column matches, then manually adjust any fields that were incorrectly paired before saving.
The Reconciliation widget maps source fields to target fields for comparison. Use Smart Mapping to automatically propose column matches, then manually adjust any fields that were incorrectly paired before saving.
The FDR_Confirm action pop up dialog exposes all available configuration options for this step. Review each field carefully and fill in the required values before clicking Save or OK to apply the configuration.
Click the Execute button to trigger the scenario and begin processing data from the configured sources. The scenario transitions to Monitor mode where you can track real-time execution progress and view interim results as each step completes.
Click the Execute button to trigger the scenario and begin processing data from the configured sources. The scenario transitions to Monitor mode where you can track real-time execution progress and view interim results as each step completes.
The FDR_Scenario exceptions page page presents the full outcome of the scenario execution including record counts, match rates, and any detected exceptions. Drill into exception records to inspect individual mismatches and use the Export to CSV option to share results with stakeholders.