Tagged articles

consumer optimization

3 articles · Page 1 of 1

Jun 16, 2026 · Backend Development

Consumer Rate Limiting: From Zero to Full Control in Million‑QPS Architectures

The article explains why consumer‑side rate limiting is essential in million‑QPS systems, detailing how unchecked consumers can overwhelm downstream services, and presents practical strategies—including pause/resume, token‑bucket algorithms, adaptive thresholds, and global coordination—to safely throttle consumption without dropping messages.

KafkaRate Limitingconsumer optimization

0 likes · 16 min read

Consumer Rate Limiting: From Zero to Full Control in Million‑QPS Architectures

dbaplus Community

Dec 30, 2025 · Backend Development

How to Tackle Massive Message Queue Backlogs in High‑Traffic Scenarios

During peak traffic like Double‑11, a message queue can accumulate millions of messages, and simply adding consumer instances only offers temporary relief; this article explains the partition model limits, how to calculate proper partition numbers, fast remediation tactics, and deep consumer‑side optimizations for robust, scalable processing.

BacklogKafkaconsumer optimization

0 likes · 20 min read

How to Tackle Massive Message Queue Backlogs in High‑Traffic Scenarios

mikechen

Aug 6, 2025 · Big Data

How to Diagnose and Fix Kafka Message Backlog in High‑Concurrency Environments

In high‑concurrency systems, Kafka message backlog occurs when producers outpace consumers, leading to unprocessed messages that threaten stability and real‑time performance, and this article explains the root causes and provides practical producer‑side and consumer‑side optimization techniques to resolve the issue.

Batch ProcessingHigh ConcurrencyRate Limiting

0 likes · 5 min read

How to Diagnose and Fix Kafka Message Backlog in High‑Concurrency Environments