Metadata Observability v7.6 beta
Overview
Metadata Observability is the primary dashboard for monitoring metadata health across your connections. It provides real-time KPIs, schema drift detection, historical time-travel capabilities, snapshot comparison, and automated reporting.
Target Persona: Data Engineers, Data Stewards, Data Governance leads.
Prerequisites: At least one connection with completed metadata extraction and multiple extraction runs (for time-travel and drift detection).
How This Module Helps
This module answers: "What changed in my metadata, and when?" It enables: - Real-time schema drift detection — know immediately when tables or columns change - Time-travel to any historical point — see metadata as it existed on any date - Snapshot comparison — diff two points in time side-by-side - Automated reporting — weekly/monthly health summaries delivered via email
| Connects To | Relationship |
|---|---|
| Metadata Analysis | Drill from KPIs to object-level detail |
| Metadata Extract & Enrich | Extraction feeds this dashboard |
| DQ Command Center | DQ integration for combined view |
Navigation
| Method | Path |
|---|---|
| Sidebar | Observability → RightSight → Metadata Observability (under Dashboards) |
| URL | /metadata-observability |
| Deep link |
/metadata-observability?connectionId=<id> pre-selects the connection |
Features & Workflows
1. Selecting a Connection
- Click the Connection dropdown.
-
Select a connection — KPIs and tabs load.
-
Optionally filter by schema using the Schema multi-select.
2. KPI Dashboard
Six real-time KPI cards:
| KPI | Description | Click Action |
|---|---|---|
| Schemas | Total schema count | Drill to Metadata Analysis |
| Tables | Total table count | Drill to Metadata Analysis |
| Views | Total view count | Drill to Metadata Analysis |
| Columns | Total column count | — |
| Drifts | Active drift alerts | Switches to Drifts tab |
| Alerts | Active alert count | Switches to Alerts tab |
3. Using Time Travel
Steps
-
Click any day in the Calendar Time Travel widget.
-
Select an hour in the Day View that appears.
-
The Time Travel Banner appears confirming the active snapshot.
-
All KPIs and tabs now show metadata as of the selected timestamp.
-
Click Exit Time Travel to return to current state.
4. Viewing Schema Drifts
- Click the Drifts tab.
-
View detected changes: schema changes, column type changes, key changes, row count changes.
-
Sort and filter by object, type, or impact.
5. Comparing Snapshots
- Click the Compare tab.
-
Select two snapshots using the Snapshot Cards.
-
View side-by-side diff of metadata changes.
6. Generating Reports
- Click the Reports tab.
-
Select a report type (Weekly Health, Monthly Evolution, etc.).
-
Click Generate to create the report.
-
Export as HTML or CSV.
7. Subscribing to Reports
-
Click Subscribe on a report.
-
Configure recipients, frequency, and format.
-
Reports are delivered via email automatically.
Cross-Module Links
| From Metadata Observability | Navigate To |
|---|---|
| KPI click → Metadata Analysis | Metadata Analysis |
| Time Travel → Metadata Analysis | Metadata Analysis with time travel context |
| Connection config → Metadata Extract | Metadata Extract & Enrich |
Tips & Best Practices
- Use the Calendar Time Travel to investigate "what changed and when" during incident response.
- Enable the "Changes Only" toggle in the calendar to focus on days with actual changes.
- Set up automated Weekly Health reports and subscribe to receive them by email.
- Use the Compare tab to verify expected vs. actual metadata changes after deployments.