SpecsModelExplore
Overview
Actors
External Systems
Data Platform
Ingestion
Storage
Data Lake
Data Warehouse
Metadata Store
Processing
Serving
Analytics UI
Governance
SpecsModelExplore
Storage
OverviewGuideLinks and Communications
IDproduct.storage
DescriptionLakehouse — raw object storage layer plus a columnar warehouse for curated data.
Keystorage
Typesystem
TeamData Platform
Ownerstorage@dataplatform.example
Statusactive
TechnologiesIceberg, Parquet, S3
Attributeslayers: bronze,silver,gold, pattern: medallion
Tags
Table of contents
Guide
Storage
System at a glance
Containers
Medallion layers
Responsibilities
Related workflows

Guide

Storage

Storage is where data lives between ingress and consumption. It separates raw history (the bronze lake on object storage) from curated analytics tables (the gold warehouse) and holds the metadata — schemas, table catalog entries and snapshot lineage — that every other system references.

Responsibility in one sentence

Persist raw and curated datasets durably, manage partitions and snapshots, and expose authoritative schema and catalog metadata to pipelines and query engines.

System at a glance

Could not build diagram for model "example-data-processing".

Containers

Data Lake

Bronze/silver Iceberg tables on object storage — partitioned Parquet with compaction.

Data Warehouse

Columnar OLAP gold layer — curated tables with time-travel snapshots.

Metadata Store

Schema registry, table catalog and version compatibility rules.

Medallion layers

The Data Lake accepts append-only writes from Ingestion. The Lake Writer partitions by time/key; the Compaction Job keeps query performance healthy.

Responsibilities

  • Bronze and silver table layout, partitioning and lifecycle tiering.
  • Gold warehouse DDL, clustering and snapshot retention.
  • Authoritative schema versions and table catalog entries.

Related workflows

CDC events land in the bronze layer as part of the sync flow:

Curated gold tables are materialized after the nightly batch completes:

Links and Communications

1 incoming link · 3 outgoing links

Incoming Links(1)

Source objectLabelLink typeRelationRaw idRequiredDescription
Ingestion

example-data-processing.product.ingestion

system
lands data in—linksproduct.storage——

Outgoing Links(3)

Target objectLabelLink typeRelationRaw idRequiredDescription
Object Storage

example-data-processing.external_systems.object_storage

external
persists to—linksexternal_systems.object_storage——
Processing

example-data-processing.product.processing

system
feeds—linksproduct.processing——
Serving

example-data-processing.product.serving

system
serves curated data to—linksproduct.serving——