SpecsModelExplore
Overview
Actors
External Systems
Data Platform
Ingestion
CDC Connectors
Batch Loader
Stream Router
Kafka ConsumerDeduplicatorTopic PartitionerDead Letter Handler
Storage
Processing
Serving
Analytics UI
Governance
SpecsModelExplore
Deduplicator
OverviewGuideLinks and Communications
IDproduct.ingestion.stream_router.deduplicator
DescriptionDrops duplicate events using idempotency keys.
Keydeduplicator
Typecomponent:cache
TeamData Ingestion
Owneringestion@dataplatform.example
Statusactive
Attributeskey: idempotency, store: Redis, ttl: 24h
Tags
Table of contents
Guide
Deduplicator

Guide

Deduplicator

Drops duplicate events using idempotency keys.

Component

Internal module inside Stream Router. See the parent container guide for the end-to-end flow this component participates in.

Links and Communications

1 outgoing link

Outgoing Links(1)

Target objectLabelLink typeRelationRaw idRequiredDescription
kafka_consumer

example-data-processing.kafka_consumer

—
——linkskafka_consumer——