| ID | product.processing.batch_pipeline |
|---|---|
| Description | Scheduled SQL/Spark jobs producing curated tables. |
| Key | batch_pipeline |
| Type | microservice:service |
| Team | Data Engineering |
| Owner | eng@dataplatform.example |
| Status | active |
| Technologies | Spark, dbt, Airflow |
| Attributes | api_style: internal, engines: Spark,dbt, schedule: daily |
| Tags |
Table of contents
Guide
Batch Pipeline
Scheduled SQL/Spark jobs producing curated tables.
Container
Part of the Processing system. Components inside this container link only to siblings — cross-container integration happens at the service boundary.
Components
Could not build diagram for model "example-data-processing".