| ID | product.processing.batch_pipeline |
|---|---|
| Description | Scheduled SQL/Spark jobs producing curated tables. |
| Key | batch_pipeline |
| Type | microservice:service |
| Status | active |
| Team | Data Engineering |
| Owner | eng@dataplatform.example |
| Technologies | Spark, dbt, Airflow |
| Tags |
Table of contents
Attributes
| api_style | internal |
|---|---|
| engines | Spark,dbt |
| schedule | daily |
Guide
Batch Pipeline
Scheduled SQL/Spark jobs producing curated tables.
Container
Part of the Processing system. Components inside this container link only to siblings — cross-container integration happens at the service boundary.
Components
Could not build diagram for model "example-data-processing".