Tagged articles
message-queue
33 articles · Page 1 of 1
This article explains why traditional message‑queue throttling fails in AI inference workloads, introduces Apache RocketMQ 5.x LiteTopic’s lightweight topic model, and details its four core features—physical isolation, elastic scaling, precise flow control, and consumption suspension—that together provide millisecond‑level real‑time throttling and minute‑level busy‑idle scheduling for personalized traffic management.
AI inferenceFlow ControlLiteTopic
0 likes · 14 min read


ITPUBJan 18, 2026 · Databases
An e‑commerce junior developer tackles the challenge of regularly syncing order data to a data warehouse, evolving from naïve full‑table copies to incremental sync, batch processing, cursor‑based pagination, performance tuning, and finally a real‑time CDC‑plus‑message‑queue architecture, while addressing reliability, ordering, and scaling issues.
CDCCursorbatch
0 likes · 13 min read

This article presents a step‑by‑step architecture for a high‑traffic flash‑sale system that filters 99.9% of requests before the database, using layered front‑end, gateway, cache, message‑queue, and stateless scaling techniques to achieve over 100,000 TPS with strong consistency and availability.
backend-architecturecircuit breakingflash sale
0 likes · 10 min read

RocketMQ ensures durable, consistent, and highly available message storage through fixed‑length append‑only files, efficient index rebuilding, checkpoint tracking, and configurable master‑slave replication, offering both synchronous and asynchronous HA modes, detailed recovery steps, performance trade‑offs, and practical operational guidelines for robust fault tolerance.
Fault RecoveryOperationsRocketMQ
0 likes · 10 min read

This article provides a detailed walkthrough of RocketMQ's IndexFile storage engine, covering its physical layout, index construction and query processes, performance benefits, limitations, lifecycle management, and how it compares to other messaging systems for fast key‑based message retrieval.
IndexStoragemessage-queue
0 likes · 10 min read

This article explains how Alibaba Cloud Lightweight Message Queue (formerly MNS) enables lossless, zero‑downtime service releases by redesigning the network entry layer, using load‑balancer draining, injecting HTTP close frames, and providing CI/CD scripts that work across ECS and Kubernetes environments.
Alibaba CloudMNScloud-native
0 likes · 12 min read

This article outlines the essential building blocks of a modern microservice architecture—traffic entry with Nginx, API gateway selection, business service design, service registration, caching and distributed locks, persistent storage strategies, document-oriented stores, messaging middleware, log aggregation, task scheduling, and distributed object storage—providing practical guidance for backend engineers.
CachingNGINXarchitecture
0 likes · 10 min read

This guide explains what NSQ is, shows how to install NSQ via Docker, set up the PHP‑NSQ extension by installing libevent and the PECL package, and provides complete PHP code examples for publishing, deferred publishing, and subscribing to messages.
NSQPECLmessage-queue
0 likes · 4 min read

This article explains why inventory overselling occurs during massive sales events, analyzes the root causes such as non‑atomic database operations, and presents practical solutions—including optimistic locking, Redis atomic scripts, distributed locks, message‑queue peak shaving, and pre‑deduct strategies—while highlighting common pitfalls and best‑practice combinations for robust e‑commerce back‑ends.
distributed-lockecommercemessage-queue
0 likes · 9 min read

This article explains how increasing consumers affects RocketMQ message backlog, details conditions where adding consumers helps or not, describes ProcessQueue flow control, outlines six load‑balancing strategies—including average, round‑robin, custom, machine‑room, nearby, and consistent‑hash—and provides corresponding Java code examples.
Consumerallocation-strategyload-balancing
0 likes · 10 min read

This article explains the fundamentals of Event‑Driven Architecture, covering its core components, design principles such as event granularity and immutability, practical implementation steps, common use cases, and the challenges developers face when building loosely coupled, high‑response distributed systems.
cqrsevent-drivenevent-sourcing
0 likes · 9 min read

This article compares Kafka and RabbitMQ across six real‑world scenarios—order sequencing, message routing, delayed processing, persistence, error handling, and throughput—explaining their strengths, limitations, and when each technology is the better choice for backend systems.
Backendcomparisonmessage-queue
0 likes · 12 min read

This guide explains Redis Pub/Sub as a communication pattern, shows what it can achieve, lists the most common commands with examples, demonstrates a multi‑client scenario, and outlines its drawbacks compared with newer Redis Streams.
BackendReal-timemessage-queue
0 likes · 5 min read

This article explains how to achieve near‑zero message loss in RabbitMQ by using producer confirm mode, durable exchanges/queues/messages, database‑backed message compensation, and manual consumer acknowledgments, providing a complete end‑to‑end reliability strategy.
Publisher ConfirmRabbitMQmanual ACK
0 likes · 9 min read

This article explains why Redis experiences key‑setting race conditions under high concurrency and presents two practical solutions—using a distributed lock with timestamps and serializing writes via a message queue—to ensure correct ordering and data consistency.
Concurrencydistributed-lockmessage-queue
0 likes · 5 min read

This article explains the causes of duplicate message consumption in RabbitMQ, demonstrates how to reproduce the issue with a 10,000‑message test, and provides three practical solutions using unique IDs stored in Redis to ensure idempotent processing in Java Spring applications.
Backendduplicate consumptionmessage-queue
0 likes · 9 min read

This tutorial walks through preparing a CentOS 7 environment, installing required plugins, setting up Erlang, downloading and building RabbitMQ Server, starting the service, enabling the management UI, and managing users and permissions with detailed command examples.
installationmessage-queue
0 likes · 4 min read

The article discusses how to achieve reasonable read/write consistency between databases and caches by emphasizing cache expiration, eventual consistency, analyzing the Cache‑Aside pattern, evaluating four update‑order options, recommending the "update‑DB‑then‑delete‑cache" approach, and suggesting async deletion via message queues and distributed locks to handle concurrency and cache breakdown.
Cache AsideConsistencydistributed-lock
0 likes · 19 min read

This article explores five practical techniques for automatically closing unpaid e‑commerce orders—ranging from simple scheduled tasks to advanced RocketMQ delay queues, RabbitMQ dead‑letter queues, time‑wheel algorithms, and Redis expiration listeners—detailing their mechanisms, trade‑offs, and implementation code.
RocketMQmessage-queueorder-closure
0 likes · 18 min read

This article explains how Redis can be used to build message queues by leveraging List commands with LPUSH/RPOP and BRPOPLPUSH for simple queues, the Stream data type introduced in Redis 5.0 for durable, ordered, consumer‑group‑based queues, and the Pub/Sub model for real‑time broadcasting, while also analyzing the underlying source code structures such as quicklist, radix trees, and stream internals.
Backenddata-structuresmessage-queue
0 likes · 21 min read

This article explains how to configure durable queues and persistent messages in RabbitMQ, avoid message loss when producers or consumers crash, use manual acknowledgments and NACK handling, and control unacknowledged message flow with prefetch settings for high‑throughput backend systems.
acknowledgmentdurabilitymessage-queue
0 likes · 10 min read

This article explores how to leverage Redis for a wide range of backend functionalities—including caching, distributed data sharing, locks, global IDs, counters, rate limiting, bitmap statistics, shopping carts, timelines, message queues, lotteries, likes, product tagging, filtering, follow relationships, and leaderboards—providing practical code examples and usage patterns.
BitmapCachingCounter
0 likes · 8 min read

This article provides a detailed overview of modern backend architecture, covering microservice fundamentals, design principles such as Conway's Law and DDD, gateway patterns, communication protocols, service registration, configuration management, observability pillars, service mesh options, and a comparative analysis of popular message‑queue technologies.
Observabilitybackend-architecturecloud-native
0 likes · 27 min read

This article explains how Kafka can suffer message loss and duplication, and provides practical configurations for the producer, broker, and consumer—including acks, retries, replication factor, min.insync.replicas, and manual offset commits—to achieve reliable, idempotent message processing.
Idempotencymessage-queuereliability
0 likes · 9 min read

This article explains how message queues help handle traffic spikes, achieve asynchronous processing, decouple services, and control flow, while covering push vs. pull models, common drawbacks, idempotency, reliability, ordering, high‑availability strategies, and a detailed comparison of ActiveMQ, RabbitMQ, RocketMQ, and Kafka to guide selection and design.
BackendMQRabbitMQ
0 likes · 38 min read

This article recounts the author's two‑year experience with Kafka in a high‑traffic restaurant ordering system, detailing why message ordering matters, the pitfalls of synchronous retries, message backlog, partition routing, primary‑key conflicts, database replication lag, and practical mitigation strategies for reliable backend processing.
Kafkadistributed-systemsmessage-queue
0 likes · 17 min read

This article describes a backend architecture for a high‑traffic e‑commerce project, detailing a cache access component and a cache update platform that use asynchronous messaging, hotspot‑key handling, versioned cache entries, and Redis to achieve low latency, high QPS support and strong data consistency.
BackendCachingdistributed-systems
0 likes · 18 min read

This article provides a comprehensive overview of RabbitMQ, covering its AMQP‑based architecture, core components such as exchanges and queues, reliability mechanisms like publisher confirms and dead‑letter queues, consumer flow control, clustering and federation modes, and related high‑availability tools.
AMQPBackendRabbitMQ
0 likes · 12 min read

This article explains how to guarantee reliable message delivery in RabbitMQ by using durable queues, the confirm mechanism, and supplemental strategies such as pre‑persisting messages to Redis, scheduled compensation tasks, and idempotent consumer design to prevent duplicate processing.
Idempotencyconfirmdistributed-systems
0 likes · 9 min read

This article explains the fundamental differences between RabbitMQ and Apache Kafka, covering asynchronous messaging patterns, the internal architectures of both systems, their respective strengths and weaknesses, and guidance on choosing the appropriate solution for various scenarios.
Backenddistributed-systemsmessage-queue
0 likes · 10 min read

This article explains RabbitMQ's typical scenarios, key roles and components, virtual host purpose, message delivery process, durability and loss‑prevention mechanisms, broadcast types, delayed queues, clustering benefits, node types, setup considerations, and cluster shutdown order.
BackendRabbitMQarchitecture
0 likes · 9 min read

This article reviews the basic RabbitMQ workflow, explains the four exchange types (fanout, direct, topic, headers), and provides step‑by‑step code examples for publish/subscribe, routing, and topic patterns to help developers design effective message routing.
BackendExchangeRabbitMQ
0 likes · 4 min read

This guide explains how to install RabbitMQ, set up a three-node Erlang-based cluster on CentOS, configure hostnames, Erlang cookies, designate disk and RAM nodes, manage services, enable mirrored queues, and verify cluster status using command‑line tools.
HARabbitMQerlang
0 likes · 9 min read
