| ID | product.ingestion |
|---|---|
| Description | Collects data from operational sources via CDC, batch APIs and event streams. |
| Key | ingestion |
| Type | system |
| Team | Data Ingestion |
| Owner | ingestion@dataplatform.example |
| Status | active |
| Technologies | Java, Kafka Connect, Debezium |
| Attributes | latency: near-real-time, paths: cdc,batch,stream |
| Tags |
Table of contents
Guide
Ingestion
Ingestion is the front door of the data platform. Every row change in a production database, every SaaS API export and every domain event on the bus passes through here before it can be stored, transformed or queried. If data enters the lakehouse at all, it enters through Ingestion first.
Responsibility in one sentence
Capture operational data from databases, APIs and event streams — with resumable offsets, schema awareness and deduplication — and land it in the bronze layer of the lakehouse.