You are viewing Admin Console - Security documentation for Data Trust v7.6 (latest).
Looking for the previous version? View v2024.06 documentation →

Security — Data Management

Monitor and manage internal database storage for exception data, snapshots, and ingested datasets.

Path: Admin Console › Security › Data Management

Note: You are logged in to Data Trust with an Admin Pro-User role to access Data Management.

Overview

Data Management gives administrators a centralised view of all internal database tables generated by Data Trust — including reconciliation exception data, validation exception data, query chain snapshots, and ingested data. From here you can monitor storage usage, review table sizes, and selectively delete data categories to free up space.

Navigating to Data Management

Data Management option in the Security sidebar

Figure 1: Security › Data Management navigation

In the left sidebar under Security, click Data Management to open the data storage monitoring page.

Data Management Page — Recon. Scenario Exception Data

Data Management page filtered to Recon Scenario Exception Data

Figure 2: Data Management — Recon. Scenario Exception Data

The Data Management page opens with a row of category summary cards at the top, each showing the number of tables and total storage used for that category. Clicking a card filters the table below to show only that category's records. The currently selected card is highlighted in green.

The table lists: Table Name, Schema Name, RD Object Name, Created On, Data Category, Rows, and Used Space (MB). Here the view is filtered to Recon. Scenario Exception Data — the exception tables generated when reconciliation scenarios are run.

Viewing Validation Scenario Exception Data

Data Management filtered to Validation Scenario Exception Data

Figure 3: Data Management — Validation Scenario Exception Data

Clicking the Validation Scenario Exception Data card filters the table to show only exception tables created by validation scenario runs. Each row shows the table name, row count, and disk space consumed. Use this view to identify large exception datasets that may need to be purged after review.

Viewing Query Chain Snapshot Data

Data Management filtered to Query Chain Snapshot Data

Figure 4: Data Management — Query Chain Snapshot Data

Clicking the Query Chain Snapshot Data card shows all snapshot tables captured during Query Chain executions. Snapshot tables can grow very large over time. Review the Rows and Used Space (MB) columns to identify tables that are safe to remove. Select individual rows and use the Delete button in the toolbar to remove unwanted snapshot data.

Caution: Deleting data from the Data Management page is irreversible. Always confirm with your team that the data is no longer needed for audits or investigations before removing records.

Data Categories Reference

Category	Description
Recon. Scenario Exception Data	Tables holding row-level exceptions from reconciliation runs
Validation Scenario Exception Data	Tables holding row-level exceptions from validation runs
Query Chain Snapshot Data	Point-in-time snapshots captured during Query Chain execution
RD Internal Tables	Internal system tables used by Data Trust for platform operations
Scenario Original Ingested Data	Source data ingested for scenario processing and comparison
Others	Miscellaneous internal tables not classified in the above categories