SpecsModelExploreRequirements
SpecsModelExploreRequirements
Kafka Consumer
Overview
Guide
Kafka consume
Twin streams
Links and Communications
IDproduct.ingestion.stream_router.kafka_consumer
DescriptionSubscribes to source topics on the platform bus.
Keykafka_consumer
Typecomponent
Statusactive
TeamData Ingestion
Owner
ingestion@dataplatform.example
Tags
Table of contents
Guide
Kafka Consumer
Kafka consume
Links and Communications
Requirements

Attributes

groupplatform
offsetcommitted
parallelismpartition

Guide

Kafka Consumer

Subscribes to source topics on the platform bus.

Component

Internal module inside Stream Router. See the parent container guide for the end-to-end flow this component participates in.

Kafka consume

Links and Communications

2 incoming links · 1 workflow · 2 async channels

Incoming Links(2)

Source objectLabelLink typeRelationRaw idRequiredDescription
Deduplicator

example-data-processing.product.ingestion.stream_router.deduplicator

component
——linksproduct.ingestion.stream_router.kafka_consumer——
Dead Letter Handler

example-data-processing.product.ingestion.stream_router.dead_letter_handler

component
——linksproduct.ingestion.stream_router.kafka_consumer——

Async links(2)

Consumes(2)

ChannelBrokerProducer

CDC change events

cdc.public · topic

Event Busexternal_systems.event_bus
  • Production Databases

Domain events

domain.events · topic

Event Busexternal_systems.event_bus
  • Stream Pipeline

Related Workflows(1)

WorkflowModelParticipant idParticipant label
Real-time event ingestion

streaming.realtime-event

example-data-processingproduct.ingestion.stream_router.kafka_consumerKafka consumer

Requirements