Deduplicator

ID	product.ingestion.stream_router.deduplicator
Description	Drops duplicate events using idempotency keys.
Key	deduplicator
Type	component
Status	active
Team	Data Ingestion
Owner	ingestion@dataplatform.example
Tags

Table of contents

Guide

Deduplicator

Drops duplicate events using idempotency keys.

Component

Internal module inside Stream Router. See the parent container guide for the end-to-end flow this component participates in.

1 incoming link · 1 outgoing link

Source object	Label	Link type	Relation	Raw id	Required	Description
Topic Partitioner example-data-processing.product.ingestion.stream_router.topic_partitioner component	—	—	links	product.ingestion.stream_router.deduplicator	—	—

Target object	Label	Link type	Relation	Raw id	Required	Description
Kafka Consumer example-data-processing.product.ingestion.stream_router.kafka_consumer component	—	—	links	product.ingestion.stream_router.kafka_consumer	—	—