Skip to main content

Row Count Compare Report

You are viewing archived documentation for Data Trust v2024.06 (previous version).
Go to the latest v7.6 documentation →

This document explains the features of the ‘Row Count Compare Report’. The Row counts compare dashboard provides the row count comparison result of the Dataset between source and target systems.

 

Note: This report is available from version 2020.12 and beyond.

 

Steps To Open the Row Count Report:

  • Click on the Reporting tab, depending on the “default dashboard” setting, the following screen will appear (in this instance, the default dashboard is “Data Quality Metrics”).
mceclip0.png
  • Click on the orange button labeled ‘Data Quality Metrics and you will see the following with a list of available dashboards.
mceclip1.png
  • Scroll down to the option ‘Row Counts Compare Dashboard’.
mceclip2.png
  • Click on the Select option on the right and the scenarios will get populated.
mceclip3.png
  • You can even filter out the scenarios. We provide you with many different options for filtering as follows:
mceclip4.png

Scenario filter options are:

  • Filter out based on the folder where it is stored.
  • Filter by scenario name.
  • Filter by functionality
  • Filter by the user who created it.
  • Filter by the profile.
  • Filter based on when it was executed.

All these filters have two options

  • ‘=’ implies the selected filter contains it (Include).
  • ‘!=’ implies the selected filter does not contain it (Exclude).

 In each of these filters, you can select multiple values too. For example, if you want to filter based on scenarios, and select multiple scenarios, you should click on the menu like button next to the select scenario label and add all the scenarios that you want to filter. Once you click the menu button the following screen will appear.

 

mceclip5.png

Select the scenarios you want to filter and click on apply. Once the filter is applied a blue tick will appear next to that option.

You can select multiple filters together. Once your filters are selected click on the tick icon in the bottom right corner to apply all the filters. You can even reset the filters using the reset button (eraser like button) or preview the filter data using the preview button (eye button).

 

mceclip6.png

 

Components of the Row Count Compare Dashboard:

The row count compare dashboard has two main components, the summary on the left side and the detailed view on the right side.

 

mceclip7.png

Summary Component:

The summary gives the number of scenarios and the percentage of passed, failed, and error.

mceclip8.png

For example, the above summary shows that

  • In total there are 17 unique scenarios in the report.
  • The total number of unique datasets is 150.
  • The number of matching pairs is 96 which means 64% passed.
  • The number of mismatching pairs is 35, which means 23.33% failed.
  • There are some errors running the scenarios for 12.67% of the pairs.

By clicking on any of these options you can see the resultant subset for that particular option populated in the detailed view section.

 

Detailed View:

The detailed view shows the detail of the scenarios selected.

 

mceclip9.png

The detail consists of the following:

  • Scenario name

This specifies the name of the scenario. You can click on the name to get a detailed view of the scenario in the query studio tab.

  • Source table

This specifies the name of the source table.

  • Count ( Next To Source Table)

This specifies the total count of the records validated from the source table. You can even sort the records or filter them based on conditions. You can select that option by clicking on the dropdown icon next to the column title as follows:

 

mceclip10.png
  • Target Table

This specifies the name of the target table.

  • Count (Next to target table)

This specifies the count of records in the target table.

  • Variance

This specifies the difference in the number of records between the source and the target tables.

  • Status

This shows whether the validation has passed, failed, or has some error.

 

mceclip11.png

 

In the above example, the orange symbol implies there is an error running the scenario. The common balance with green implies the validation passed and the common balance with orange implies the validation failed.

  • Threshold

This shows if there was any threshold set for that scenario.

  • Result History

This shows the number of times the scenario was executed and whether it passed, failed, or showed some error.

mceclip12.png

You can even get a graph representation of the result history by clicking on the graph symbol in that column.

mceclip13.png

The above graph shows that the first two times the execution passed and the last two times it failed or had some error. You can get the detail by hovering on the dot.

mceclip14.png

In the above example by hovering on the orange dot you can know that it was an error with an exception executed on that particular date and time.

  • Executed by

This shows the username of the person who executed this query. So, if you see any error it becomes easier to track the changes.

  • Executed On

This gives us the day and time of the execution. It can help you analyze whether the result is for the latest changes or not.

  • Folder Path

This helps to track the exact folder location where the scenario is saved.

Was this article helpful?