SpecsModelExplore
Overview
Actors
External Systems
Data Platform
Ingestion
Storage
Processing
Serving
Analytics UI
Governance
Data Catalog
Lineage Tracker
Quality Monitor
Access Control
Governance
System at a glance
Containers
Four pillars
Responsibilities
Related workflows
SpecsModelExplore
Governance
OverviewGuideLinks and Communications

Governance

Governance is the trust layer of the data platform. It answers four questions every consumer asks before trusting a number: what is this dataset, where did it come from, is it good enough, and am I allowed to see it? Every pipeline run, query and dashboard publish is observable through this system.

Responsibility in one sentence

Catalog datasets with ownership, track lineage, enforce quality rules with incident response, and apply row/column access policies with a full audit trail.

System at a glance

Could not build diagram for model "example-data-processing".

Containers

Data Catalog

Searchable registry of datasets, columns, owners and tier tags.

Lineage Tracker

Dataset-to-dataset graph built from pipeline lineage events.

Quality Monitor

Scheduled and on-demand quality checks with incident publishing.

Access Control

Row/column policies, masking rules and immutable audit log.

Four pillars

The Catalog Repository stores ownership, tier and tag metadata. Stewards curate entries via the Data Catalog API.

Responsibilities

  • Dataset metadata, ownership and tier classification.
  • End-to-end lineage graph and impact analysis.
  • Quality rule definitions, check execution and incident workflow.
  • Access policies, column masking and compliance audit trail.

Related workflows

Quality validation gates the nightly batch before gold tables update:

Access control is applied when an analyst publishes a dashboard:

Platform-wide guarantee

Governance aims for full audit coverage — every query, publish and policy change is recorded. When quality rules fail, downstream pipelines halt rather than propagate corrupt data.