SpecsModelExplore
Overview
Actors
External Systems
Data Platform
Ingestion
Storage
Processing
Orchestrator
Batch Pipeline
Stream Pipeline
Stateful ProcessorWindow AggregatorEnrichment EngineLate Data Handler
Serving
Analytics UI
Governance
SpecsModelExplore
Stream Pipeline
OverviewGuideLinks and Communications
IDproduct.processing.stream_pipeline
DescriptionStateful Flink / Spark Streaming jobs.
Keystream_pipeline
Typemicroservice:service
TeamData Engineering
Ownereng@dataplatform.example
Statusactive
TechnologiesSpark, dbt, Airflow
Attributesengine: Flink, mode: streaming, state: keyed
Tags
Table of contents
Guide
Stream Pipeline
Components

Guide

Stream Pipeline

Stateful Flink / Spark Streaming jobs.

Container

Part of the Processing system. Components inside this container link only to siblings — cross-container integration happens at the service boundary.

Components

Could not build diagram for model "example-data-processing".

Links and Communications

1 incoming link · 1 workflow

Incoming Links(1)

Source objectLabelLink typeRelationRaw idRequiredDescription
Stream Router

example-data-processing.product.ingestion.stream_router

microservice:service
feeds—linksproduct.processing.stream_pipeline——

Related Workflows(1)

WorkflowModelParticipant idParticipant label
Real-time event ingestion

streaming.realtime-event

example-data-processingproduct.processing.stream_pipelineStream pipeline