Tag

Message Duplication

1 views collected around this technical thread.

Top Architect
Top Architect
Mar 30, 2023 · Backend Development

Understanding Kafka Idempotent Producer and How to Prevent Message Duplicates

This article explains why message duplication occurs in Kafka, describes the three delivery semantics, and provides practical solutions—including idempotent producers, transactions, and consumer-side idempotence—along with configuration tips and code examples to achieve exactly‑once delivery.

JavaKafkaMessage Duplication
0 likes · 11 min read
Understanding Kafka Idempotent Producer and How to Prevent Message Duplicates
Top Architect
Top Architect
Jan 31, 2023 · Backend Development

Solving Kafka Message Duplication with Idempotent Producer, Transactions, and Consumer Idempotence

This article explains why message duplication occurs in Kafka pipelines, describes the three delivery semantics, and provides three practical solutions—Kafka idempotent producer, Kafka transactions, and consumer‑side idempotence—along with configuration tips and code examples.

Consumer IdempotenceIdempotent ProducerKafka
0 likes · 11 min read
Solving Kafka Message Duplication with Idempotent Producer, Transactions, and Consumer Idempotence