Skip to main content

Data Quality Jobs

RightSight User Guide  ·  Module 9 of 14

Data Quality Jobs v7.6 beta

Create, schedule, execute, and monitor data quality rule execution jobs.

Overview

Data Quality Jobs is where you create, schedule, and monitor the execution of data quality rules against your data sources. Jobs bundle active rules and run them on a schedule or on-demand.

Target Persona: Data Engineers, DQ Engineers, Data Stewards.

Prerequisites: Active DQ rules configured in Review & Confirm (DQ).

How This Module Helps

DQ Jobs are the execution engine for your data quality program. Without jobs, rules are just definitions — jobs make them actionable by: - Bundling rules into scheduled execution packages - Running rules against live data on a cadence - Providing execution history and trend tracking - Alerting when jobs fail or quality degrades

Connects To Relationship
Review & Confirm (DQ) Active rules are included in jobs
DQ Results Job execution produces results
Metadata Extract & Enrich Job connections reference extracted metadata
Method Path
Sidebar Observability → RightSight → Data Quality Jobs (under Data Quality)
URL /data-quality-run-schedule
Wizard Augmented DQ Config → Step 7
Deep link /data-quality-run-schedule?fromWizard=true&connectionId=<id>

Features & Workflows

1. Creating a Job

Steps

  1. Click + Create Job in the header.
Create Job button
Figure 1: Create Job button
  1. The Job Form Modal opens.
Job Form Modal
Figure 2: Job Form Modal
  1. Fill in the job definition:
Field Type Required Description
Job Name Text Yes Descriptive name for the job
Connection Dropdown Yes Target connection profile
Rules Multi-select Yes Rules to include in this job
Schedule Scheduler No Cron-based schedule (or leave blank for manual-only)
Description Textarea No Job description
Job Form Modal filled
Figure 3: Job Form Modal filled
  1. Configure the schedule (optional):
Schedule Type Description
Hourly Every N hours
Daily At a specific time each day
Weekly On specific days at a specific time
Monthly On a specific day of the month
Custom Cron Full cron expression
One-time Run once at a specific date/time
Schedule configuration
Figure 4: Schedule configuration
  1. Click Save to create the job.
What Happens Next
  • The job appears in the Jobs List as a card.
  • If a schedule was set, the job status is Scheduled.
  • If no schedule, the job status is Active (manual execution only).

2. Editing a Job

Steps

  1. Click ⚙ Edit on a job card.

  2. The Job Form Modal opens in edit mode with pre-filled values.

  3. Modify fields as needed.

  4. Click Save to apply changes.

3. Running a Job

Steps

  1. Click ▶ Run Now on a job card.

  2. The Smart DQ Job Confirmation Dialog appears.

The dialog shows: - Number of rules to execute - Estimated duration - Warnings about concurrent executions - Rule freshness information

  1. Click Confirm to start execution.

  2. The Logs Drawer auto-opens with real-time progress.

What Happens Next
  • The job card shows Running status with a spinner.
  • On completion, results are available in DQ Results.
  • The Last Run section on the card updates with pass/fail counts.

4. Viewing Job Details

Steps

  1. Click on a job card (not on an action button).
Click job card
Figure 5: Click job card
  1. The Job Details Modal opens.
Job Details Modal
Figure 6: Job Details Modal
  1. View:
  2. Overview — Job configuration summary
  3. Execution History — Table of past runs
Execution History table
Figure 7: Execution History table
  1. Click any run in the history to navigate to its results.

5. Viewing Logs

Steps

  1. Click 📋 Logs on a job card.

  2. The Log Drawer opens.

  3. During execution: real-time log streaming.

  4. After execution: browse historical logs.

  5. Click any log entry for full details.

6. Navigating to Results

  1. Click 📊 Results on a job card.

  2. You are navigated to DQ Results with the job pre-selected.

7. Pausing / Resuming / Deleting a Job

Steps

  1. Click the context menu (⋮) on a job card.

  2. Choose an action:

Action From Status To Status
Pause Active/Scheduled Paused
Resume Paused Active
Delete Any Deleted
  1. Confirm the action.

8. Filtering Jobs

Use the filter bar to narrow the Jobs List:

Filter Options
Connection All connections / specific connection
Created By All users / specific user
Status Badge All / Active / Scheduled / Completed / Failed
From DQ Jobs Navigate To
Job rules → from Review & Confirm Review & Confirm (DQ)
Job results → DQ Results DQ Results
Job connection → Metadata Extract Metadata Extract & Enrich
Wizard → next step DQ Results

Tips & Best Practices

  • Schedule critical DQ jobs to run after data load completion for accurate results.
  • Use the Smart Confirmation Dialog hints to avoid running large jobs during peak hours.
  • Keep job scope focused — many small jobs are better than one massive job for debugging.
  • Monitor the Execution History tab to track quality trends over time.
  • Set up alerts on job failures via the notification configuration.
Was this article helpful?