Tag

Duplicate Consumption

1 views collected around this technical thread.

Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Jul 3, 2024 · Backend Development

Preventing Duplicate Message Consumption in Kafka

This article explains why duplicate message consumption occurs in Kafka, outlines the underlying confirmation and consumer failure issues, and presents idempotent design strategies such as deduplication tables and code examples to ensure reliable processing.

Duplicate ConsumptionIdempotencyKafka
0 likes · 5 min read
Preventing Duplicate Message Consumption in Kafka
Top Architect
Top Architect
Sep 29, 2022 · Backend Development

Handling Duplicate Consumption in RabbitMQ: Scenarios, Tests, and Solutions

This article explains the causes of duplicate message consumption in RabbitMQ, demonstrates how to reproduce the issue with a 10,000‑message test, and provides three practical solutions using unique IDs stored in Redis to ensure idempotent processing in Java Spring applications.

Duplicate ConsumptionJavaMessage Queue
0 likes · 9 min read
Handling Duplicate Consumption in RabbitMQ: Scenarios, Tests, and Solutions
Selected Java Interview Questions
Selected Java Interview Questions
Aug 7, 2022 · Backend Development

Ensuring Message Reliability in RocketMQ: Producer, Broker, and Consumer Strategies

This article explains how RocketMQ reduces message loss and duplicate consumption through synchronous sending, retry mechanisms, multi‑master brokers, synchronous disk flushing, master‑slave replication, at‑least‑once delivery, and idempotent processing techniques.

BrokerConsumerDuplicate Consumption
0 likes · 10 min read
Ensuring Message Reliability in RocketMQ: Producer, Broker, and Consumer Strategies
Full-Stack Internet Architecture
Full-Stack Internet Architecture
Jul 4, 2020 · Big Data

Common Kafka Interview Questions: Delay Queues, Idempotence, ISR/AR, HW/LEO/LSO, Message Ordering, and Duplicate Consumption

This article reviews typical Kafka interview topics, explaining the implementation of delay queues with hierarchical time wheels, how idempotence is achieved via producer IDs, the meanings of ISR, OSR, AR, HW, LEO, LSO, strategies for guaranteeing message order, and practical solutions for handling duplicate consumption.

Delay QueueDuplicate ConsumptionISR
0 likes · 9 min read
Common Kafka Interview Questions: Delay Queues, Idempotence, ISR/AR, HW/LEO/LSO, Message Ordering, and Duplicate Consumption