This article explains the fundamentals of AMQP 0‑9‑1, describing its core components such as exchanges, queues, bindings, virtual hosts, channels, and acknowledgment mechanisms, and compares RabbitMQ’s messaging model with Kafka’s streaming architecture.
This article walks through a real‑world RocketMQ failure where a consumer could not receive messages due to an unreachable VIP port, explains the broker’s three‑port architecture, shows how to diagnose the problem via logs, and provides code and configuration fixes to restore normal consumption.
RabbitMQ lacks native delayed‑queue support, but by combining message TTL with a dead‑letter exchange you can create a 15‑minute delayed processing pipeline for order cancellation, and this article explains the configuration steps and consumer setup needed to achieve it.
When a RabbitMQ server accumulates thousands of pending messages, a newly started consumer can be flooded, causing performance degradation or crashes, so this guide explains how to use RabbitMQ's QoS settings and manual acknowledgments to throttle consumers and keep the system stable.
This article explains RabbitMQ exchanges, their key properties, and the four main exchange types—direct, topic, fanout, and headers—while providing step‑by‑step visual demos that show how messages are routed, filtered, or broadcasted in real scenarios.
This tutorial explains RabbitMQ fundamentals, shows how to install the Pika client, provides complete producer and consumer Python examples, and covers advanced topics such as work queues, message acknowledgments, persistence, fair dispatch, exchanges, routing, and RPC usage.
This article presents a detailed overview of Alipay's multi‑layer system architecture, explains the design and capabilities of its open‑source Java‑based distributed message middleware Metamorphosis (MetaQ), and discusses why it was created as an alternative to Kafka and the scenarios where it excels.
This article provides a comprehensive overview of RabbitMQ, covering its origins, architecture, message routing patterns, persistence mechanisms, clustering, mirrored queues, flow control, and code examples for publishing and consuming messages, helping backend developers understand and effectively use the system.
The PHP Kafka client library supports PHP‑FPM and Swoole environments, implements all 50 Kafka APIs with compression, SSL, and SASL features, requires PHP ≥ 7.1 and Kafka ≥ 1.0.0, and can be installed via Composer.
This article details Vivo's evolution of RabbitMQ from a single cluster to a multi‑cluster, high‑availability solution, describing the MQ‑Portal request workflow, the enriched client SDK features, the stateless MQ‑NameServer, and the dual‑city deployment strategies that enabled a ten‑times traffic increase without major outages.
This guide explains what a message queue is, why it’s used in asynchronous architectures, walks through installing RabbitMQ on Linux and macOS, and demonstrates core patterns such as simple queues, work queues, publish/subscribe, routing, topics, and RPC with complete Python code examples.
This article provides a comprehensive overview of Kafka as a distributed messaging middleware, covering its core concepts, architecture, producer and consumer mechanics, common interview questions, configuration options, high‑availability guarantees, and performance optimizations for backend developers.
This article introduces RocketMQ’s core concepts, including its deployment architecture, naming server, broker and client roles, subscription model, consumption modes, queue allocation algorithms, rebalancing, offset storage, transaction and delayed messages, as well as filtering mechanisms, providing a solid foundation for further practice.
This article explains why message queues are used, their advantages and disadvantages, compares Kafka, ActiveMQ, RabbitMQ, and RocketMQ, and provides interview-focused guidance on high availability, idempotency, reliability, ordering, and handling of message backlog.
This article uses a whimsical group‑chat metaphor to compare four popular message‑queue systems—RabbitMQ, Kafka, RocketMQ and ActiveMQ—explaining their origins, latency, throughput, UI differences, and typical use‑cases such as throttling, decoupling and asynchronous processing.
vivo built a high‑availability RabbitMQ middleware platform that combines an MQ‑Portal for request‑driven provisioning, an SDK that adds application‑level authentication, automatic cluster discovery, rate‑limiting, reset and blockage‑transfer capabilities, and a stateless MQ‑NameServer for name resolution and health‑based failover, enabling ten‑fold traffic growth without incidents.
This article explains how Redis can be used to implement delayed queues, compares its advantages with other solutions such as RabbitMQ, RocketMQ, Kafka, Netty and Java DelayQueue, and provides practical guidance on using sorted sets and timestamps for time‑based task scheduling.
This article analyzes the possible message loss scenarios in RocketMQ—including producer network issues, broker persistence failures, and consumer acknowledgment problems—and presents practical solutions such as transactional messaging, synchronous disk flushing, and proper consumer handling to achieve zero message loss.
This article provides a comprehensive overview of RabbitMQ, covering its origins, core components, message publishing and consumption patterns, routing modes, persistence mechanisms, delivery guarantees, RPC support, clustering design, mirrored queues, and flow‑control strategies for reliable backend messaging.
This article explains the fundamental architecture of message middleware, its key roles such as peak shaving, asynchronous processing and decoupling, the two consumption models (publish‑subscribe and point‑to‑point), and introduces core Kafka concepts with practical Java code examples.
This article explains the fundamentals of distributed systems, covering the CAP and BASE theorems, caching strategies, message queues, database choices, JVM optimization, and practical architectural improvements applied to New Oriental's mobile app to enhance availability and performance.
This article provides a comprehensive overview of Apache RocketMQ, covering its core concepts, architecture, various message types, reasons for adoption such as asynchronous decoupling and peak‑shaving, as well as best practices and local transaction patterns for reliable distributed messaging.
This article explains the three common scenarios where messages can be lost in RocketMQ, analyzes their root causes, and presents concrete solutions—including transactional messaging, synchronous disk flushing with replication, and proper consumer acknowledgment—to achieve zero‑message loss while noting the performance trade‑offs.
This article explains why caching is essential for high‑traffic MySQL applications, outlines the consistency challenges of using Redis as a cache, and compares four practical synchronization solutions—TTL‑only, write‑through, message‑queue‑based, and binlog‑driven—highlighting their advantages, drawbacks, and selection guidelines.
This article explains the fundamentals of message queues, why they are needed for decoupling, asynchronous processing and throttling, introduces JMS concepts, details ActiveMQ storage options and protocols, and provides practical Java and Spring Boot code examples for producers, consumers, and advanced features such as transactions, persistence, and delayed delivery.
This article demonstrates how to build a robust email‑sending service using Spring Boot and RabbitMQ, covering message confirmation, consumer idempotency, retry mechanisms, configuration details, and complete source code examples for producers, consumers, and scheduled re‑delivery tasks.
This article examines common RocketMQ message loss scenarios—including network glitches, asynchronous disk flushing, and consumer acknowledgment failures—and presents practical solutions such as transactional messaging, synchronous flush configuration, and proper consumer handling to achieve zero message loss.
This article provides a comprehensive introduction to message queues, covering their historical origins, key standards such as JMS and AMQP, reasons for adoption, advantages and drawbacks, and a comparative analysis of popular implementations like ActiveMQ, RabbitMQ, RocketMQ, and Kafka.
This article explains Kafka's role as a message system, details its fundamental components such as topics, partitions, producers, consumers, and replicas, describes how Zookeeper coordinates the cluster, and explores performance optimizations like sequential writes, zero‑copy, and network design.
This article explains the core purposes of message queues such as converting synchronous operations to asynchronous, decoupling services, and handling traffic spikes, then details RabbitMQ architecture, various exchange types (Direct, Topic, Fanout), provides Spring‑Boot code examples for producers and consumers, and discusses persistence, acknowledgment mechanisms, and best‑practice configurations for reliable messaging.
This comprehensive guide walks through downloading and installing RocketMQ on Windows, configuring environment variables, starting services, integrating the RocketMQ console, explaining core components, message models, reliability strategies, duplicate handling, transaction messages, and ordering guarantees for robust distributed messaging systems.
This guide explains how to use Spring Boot's ActiveMQ starter to configure, code, and test both queue (point‑to‑point) and topic (publish‑subscribe) messaging, covering JMS fundamentals, project setup, bean definitions, listener annotations, and dual‑mode container factories.
This article introduces RabbitMQ’s core concepts, explains message reliability features, and demonstrates a practical order‑creation scenario with Java code that publishes messages, consumes them for score updates and notifications, and shows the resulting output.
This article explains how Tencent’s cloud‑native message queue TDMQ, built on Apache Pulsar’s storage‑compute separation, meets financial‑grade reliability, strong consistency, horizontal scalability, and cross‑region disaster‑recovery requirements through a quorum‑based consistency model, multi‑protocol support, and read‑only broker design.
This article provides a comprehensive introduction to Kafka, covering its role as a messaging system, core concepts such as topics, partitions, producers, consumers, and messages, and then delves into the cluster architecture including replicas, consumer groups, controller coordination with Zookeeper, performance optimizations, log segmentation, and network design.
This guide walks you through creating a three‑node Kafka cluster with Zookeeper using Docker‑Compose, configuring the necessary YAML, launching the containers, and then integrating the cluster into a Spring Boot application by adding dependencies, setting Kafka properties, defining message, sender, and receiver classes, and testing the message flow.
This article explains the significance of data compression, outlines when it should be applied, compares lossless algorithms, discusses segment selection, and details how Kafka and RocketMQ implement message compression to improve throughput while balancing CPU, storage, and network resources.
This article explains how to use RocketMQ with Spring Boot to implement peak‑shaving, covering core components, consumer configuration, Maven setup, code examples, performance testing, and strategies for dynamic scaling and batch consumption.
Message backlog in MQ systems can cripple performance; this guide explains why backlogs occur, how to trace their root causes, and practical producer‑ and consumer‑side optimizations—including batching, concurrency, partition scaling, and dead‑letter handling—to restore throughput and prevent future congestion.
This article compares RabbitMQ and Apache Kafka, explaining their internal mechanisms, key differences in ordering, routing, timing, retention, fault tolerance, scalability, and consumer complexity, and provides guidance on when to choose each technology for modern micro‑service architectures.
The article examines why tightly coupled microservices cause reliability issues, then presents practical techniques—such as converting synchronous calls to asynchronous messaging, adopting event‑driven architecture, using CQRS, caching, and strategic refactoring—to achieve loose coupling and improve system resilience.
This guide explains practical techniques—service splitting, caching, message queues, database sharding, read/write separation, and Elasticsearch—to design high‑concurrency back‑end systems that impress interviewers and handle real‑world traffic spikes.
This article provides an extensive overview of Apache Kafka, covering its use cases, key concepts such as ISR, AR, HW, LEO, and LW, message ordering, the roles of partitioners, serializers and interceptors, producer and consumer client architecture, offset handling, multithreaded consumption, and topic partition management.
The article examines a recurring RocketMQ error (TIMEOUT_CLEAN_QUEUE) caused by the broker’s fast‑failure mechanism, explains how the broker queues and thread pools operate, reveals that SYSTEM_BUSY is mistakenly excluded from retry logic—a bug—and proposes both a temporary configuration tweak and a permanent code fix via a PR.
This article provides a comprehensive overview of Apache Kafka, explaining its distributed, fault‑tolerant architecture, horizontal scalability, disk‑based commit log, replication mechanisms, Streams API, KSQL, and why it is widely adopted as the backbone of event‑driven, high‑throughput systems.
This article provides a comprehensive overview of message queue concepts, covering usage scenarios, advantages, drawbacks, technology selection, high‑availability architectures, duplicate handling, data loss prevention, ordering guarantees, latency management, and design principles, supplemented with interview‑style questions and code examples.
The article analyzes real‑world network and disk I/O issues encountered in Qunar Message Queue (QMQ), explains root causes such as Netty OOM, file‑handle exhaustion, TCP timeout handling, and large‑traffic bursts, and presents practical mitigation strategies for backend systems.
This article explains the role of message queues in distributed systems, illustrates four typical scenarios—asynchronous processing, application decoupling, traffic shaping, and message communication—and compares the features of popular middleware such as ActiveMQ, RabbitMQ, RocketMQ, and Kafka.
This article explains why consumer‑side flow control is needed in RabbitMQ, demonstrates how to use the QoS API and basicQos settings, shows practical Java code for limiting consumption, and covers TTL and dead‑letter queue configurations to improve message reliability and system stability.
This article explains why and how to throttle RabbitMQ consumers using QoS settings, demonstrates practical Java code for consumer‑side flow control, explores message and queue TTL configurations, and details the setup of dead‑letter exchanges and queues to handle undelivered messages.
This article explains how to use RocketMQ for traffic‑shaping in a Spring Boot application, covering its core components, consumer pull configuration, integration via rocketmq‑spring‑boot‑starter, a practical like‑praise use case, a Maven setup, YAML configuration, and advanced topics such as dynamic scaling and batch consumption.
This comprehensive guide explores Redis fundamentals, detailing its six primary data structures—strings, lists, hashes, sets, sorted sets, and streams—along with practical command examples, internal implementations, and usage patterns for high‑performance backend development.
This article analyzes a severe ActiveMQ message‑queue backlog caused by a synchronized onMessage listener, then demonstrates how removing the lock and tuning the queuePrefetch parameter, along with a dual‑queue redesign, can boost consumption throughput by over thirty times, eliminating the data pile‑up.
The article explains why and how to use message queues to achieve low‑coupling, better performance, fault tolerance, and eventual consistency in an e‑commerce order‑processing flow, discusses common pitfalls such as message loss and duplication, and compares popular queue products like RabbitMQ, Kafka, and RocketMQ.
This article explains how Kafka’s design—its broker architecture, use of sequential disk I/O, PageCache, Sendfile, and a custom memory buffer pool—optimizes JVM garbage collection and achieves massive throughput in big‑data messaging scenarios.
This article explores the AMQP 0.9.1 protocol in depth, covering its core concepts, model components, layered architecture, lifecycle of exchanges, queues, channels, and bindings, as well as command classes, transport details, and practical usage patterns for building robust messaging systems.
This guide walks through installing the RabbitMQ delayed‑message‑exchange plugin, configuring it in a Spring Boot application, and building Java components to send and receive delayed order‑cancellation messages, comparing the plugin approach with dead‑letter queues and providing complete code snippets and deployment steps.
This article explains the relationship between Kafka consumers and consumer groups, when repartition occurs, how consumers interact with Zookeeper, the overall consumer workflow, and the three delivery semantics (at‑least‑once, at‑most‑once, exactly‑once) in a concise, technical overview.
This article explains how to integrate RocketMQ with Spring Boot to implement peak‑shaving, detailing core components, consumer pull parameters, one‑way sending, batch consumption configuration, and practical performance testing with code examples and deployment tips.
This article explains how Kafka can be used for data ingestion and event distribution by illustrating production‑consumer and publish‑subscribe models, describing core concepts such as topics, partitions and consumer groups, and offering practical design options for handling different event scenarios.
This article explains how RocketMQ’s decoupling, asynchronous and peak‑shaving features can be applied in a Spring Boot project to buffer massive like‑click traffic, reduce database pressure, and dynamically tune consumer pull parameters for optimal throughput.
This article introduces the fundamentals of message queues, explains their characteristics, delivery models, transmission modes, and push‑pull patterns, then compares four popular implementations—ActiveMQ, RabbitMQ, RocketMQ, and Kafka—highlighting each system's strengths, weaknesses, deployment requirements, and typical use cases.
This comprehensive guide covers Kafka's definition, publish/subscribe model, key components, storage mechanisms, producer and consumer strategies, and reliability features such as ACK levels, ISR, and exactly‑once semantics, providing a solid foundation for real‑time big‑data processing.
YouZan’s real‑time loss‑prevention platform monitors database binlogs, transforms and verifies transaction data across five loosely coupled layers, handling 200 million daily messages and 60 million checks with dynamic sharding, caching and distributed locks to detect over‑charges, duplicate refunds, migration inconsistencies and unauthorized data changes.
This article provides a comprehensive guide to using RocketMQ, covering producer and consumer message handling, tag and key usage, logging, failure retry strategies, oneway sending, broker roles, name server addressing, client configuration, JVM and Linux kernel tuning, and practical code examples.
This article provides a comprehensive introduction to Kafka, covering its definition, message queue concepts, architecture components, installation steps, configuration details, startup procedures, operational commands, producer and consumer mechanisms, reliability guarantees, partition strategies, offset management, and performance optimizations.
This comprehensive guide explains how to enhance RabbitMQ reliability by covering confirmation mechanisms, producer and consumer configurations, queue mirroring, alerting, monitoring metrics, and health‑check commands, providing actionable steps for developers and operations teams to ensure stable message delivery.
This article provides a comprehensive introduction to Kafka, covering its definition, message‑queue models, architecture components, installation steps, configuration details, producer and consumer mechanisms, reliability guarantees, partition assignment strategies, offset management, and high‑performance read/write techniques.
This article explains how to design and scale a RabbitMQ cluster capable of handling millions of messages per second, covering core concepts, Google’s large‑scale test setup, sharding and federation plugins, mirror queues, reliability mechanisms, and practical tips for high‑availability and performance optimization.
This article introduces RabbitMQ, explains its core concepts and AMQP protocol, outlines common scenarios such as decoupling, asynchronous processing, and traffic shaping, and discusses the benefits and challenges of integrating a message queue into backend architectures.
This article compares RabbitMQ and Apache Kafka across architecture, message ordering, routing, timing, retention, fault handling, scalability, and consumer complexity, providing guidance on when to prefer each system based on functional and non‑functional requirements.
This article introduces the challenges that message middleware must address, examines how Apache RocketMQ tackles these issues through its architecture, deployment models, and feature set, and provides a concise overview of its core components, reliability mechanisms, and operational characteristics.
Kafka achieves its remarkable speed by combining sequential I/O, batch processing, compression, zero‑copy, careful client‑side work, and a design that avoids costly fsync and garbage collection, while maintaining durability, ordering, and at‑least‑once delivery, making it a high‑throughput, low‑latency event streaming platform.
This article explains the fundamentals of asynchronous messaging, compares the architectural differences between RabbitMQ and Apache Kafka, and provides guidance on selecting the appropriate technology based on use‑case requirements such as scalability, durability, and processing semantics.
This article provides a comprehensive introduction to Apache Kafka, covering its high‑throughput distributed architecture, core concepts such as topics, partitions, brokers, producers and consumers, design goals, performance characteristics, deployment steps, configuration, and example code for producers, consumers, and Spring Boot integration.
This article introduces Kafka's role as a message system, explains its fundamental components such as topics, partitions, producers, consumers, and replicas, and dives into cluster architecture, consumer groups, Zookeeper coordination, and performance optimizations like sequential writes, zero‑copy, log segmentation, and network design.
The article explains why message queues are used, outlines their core scenarios—decoupling, asynchronous processing, and traffic shaping—compares Kafka, ActiveMQ, RabbitMQ, and RocketMQ, and details how to ensure high availability, reliability, idempotency, ordering, and scalability in production systems.
This article explains RocketMQ's transaction message feature, covering core concepts, the execution flow, and provides complete Java code examples for an order service and a product service that demonstrate how distributed transactions are implemented and verified.
This article explains how modern message middleware works by describing the two primary communication styles—message queuing and publish‑subscribe—illustrating each with examples, comparing their characteristics, and listing common middleware products to help developers choose the appropriate solution for their backend systems.
Tencent Cloud CKafka powers Tencent Classroom’s pandemic‑era online teaching by replacing a custom queue with a high‑performance, highly available, partition‑based message bus that scales to millions of real‑time interactions, offers configurable replication and tuning for reliability, and integrates with big‑data and streaming tools for analytics.
This article provides a detailed side‑by‑side comparison of five popular message‑queue systems—Kafka, RabbitMQ, ZeroMQ, RocketMQ and ActiveMQ—covering documentation, supported languages, protocols, storage, transactions, load balancing, clustering, management interfaces, availability, throughput, subscription models, ordering, acknowledgments, replay, retry, concurrency and more.
This article provides a comprehensive interview‑oriented overview of message queues, explaining why they are used, their core advantages and disadvantages, comparing Kafka, RabbitMQ, ActiveMQ and RocketMQ, and detailing high‑availability, reliability, idempotency, ordering, backlog handling and architectural design considerations.
This article explains common delayed‑queue scenarios, demonstrates how to implement a delay queue using Redis Zset with atomic Lua scripts, and shows how to deploy and use Beanstalkd—including Java client setup and sample producer/consumer code—while offering extensions and best‑practice tips.
This article provides a detailed side‑by‑side comparison of five popular message‑queue systems—Kafka, RabbitMQ, ZeroMQ, RocketMQ and ActiveMQ—covering documentation, language support, protocols, storage, transactions, load balancing, clustering, management UI, availability, duplication handling, throughput, subscription models, ordering, acknowledgments, replay, retry mechanisms and concurrency.
This article compiles essential Kafka interview material, covering its role as a message queue, usage scenarios, architectural components, storage mechanisms, consumer group rebalancing, high‑availability features, replication details, ordering guarantees, producer/consumer client design, topic management, log retention, performance optimizations, and key monitoring metrics.
This article details ByteDance's (今日头条) migration to RocketMQ, explaining the business drivers, the reasons for choosing RocketMQ, the proxy‑based architecture for producers and consumers, performance gains, operational challenges, and the disaster‑recovery designs implemented to ensure high availability in a micro‑service environment.
This article explains how to evolve a simple single‑node backend by adding a reverse proxy, introducing load balancers, scaling databases, adopting micro‑services, leveraging caches and CDNs, using message queues, and applying partitioning techniques to handle massive traffic while maintaining consistency and reliability.
TubeMQ is a trillion‑level, Java‑based distributed message‑queue middleware designed for massive‑data ingestion, offering 140 k TPS with sub‑5 ms latency, high reliability, low cost, and horizontal scalability, and is being open‑sourced to the Apache foundation to foster community collaboration and future expansion beyond traditional MQ functions.
This article details NetEase Cloud Music's journey from evaluating RabbitMQ, Kafka, and RocketMQ to designing a fully controllable, high‑availability message queue with failover, tracing, monitoring, and numerous custom extensions that now serve hundreds of services and billions of messages daily.
This article explains the role of message‑queue middleware in distributed systems, covering its communication patterns, ten key advantages such as decoupling and scalability, and practical use cases like asynchronous processing, traffic shaping, log handling, and e‑commerce architectures.
This article provides a comprehensive overview of RocketMQ, covering its architecture, how it handles ordered and duplicate messages, transaction processing, producer and consumer mechanisms, storage design, subscription models, and practical best‑practice recommendations for building reliable distributed messaging systems.
This article explains how Zookeeper functions as an essential part of Kafka by managing broker status, controller election, quotas, ISR tracking, node and topic registration, as well as consumer offset storage and registration, providing a comprehensive overview for interview preparation.
This article details Xiaomi's journey from Kafka 0.8 to the home‑grown Talos system, covering business motivations, storage‑compute separation architecture, key challenges such as tail‑read and consistency, and extensive performance, resource, and platform optimizations that enable a high‑throughput, multi‑tenant messaging service.
This article provides a comprehensive overview of Apache Kafka, covering its fundamental capabilities, typical use cases, core components, key APIs, and essential concepts such as topics, partitions, segments, brokers, producers, and consumers, illustrated with diagrams.
This article explains the fundamental properties of message queues, why they are needed, the advantages they bring such as improved response speed, stability, and decoupling, and discusses distributed system challenges and practical implementation considerations for selecting and deploying a suitable message‑queue solution.
This article provides a comprehensive guide to using Spring‑Kafka, covering simple integration, embedded Kafka for testing, creating topics programmatically, advanced KafkaTemplate usage, transactional messaging, ReplyingKafkaTemplate for request‑reply, listener configurations, manual acknowledgments, lifecycle control, message forwarding, and retry with dead‑letter queues.
This article provides a comprehensive 17‑point comparison of five popular message queue systems—Kafka, RabbitMQ, ZeroMQ, RocketMQ, and ActiveMQ—covering documentation, supported languages, protocols, storage, transactions, load balancing, clustering, management UI, availability, message duplication, throughput, subscription models, ordering, acknowledgments, replay, retries, concurrency, and more.
This article details ByteDance’s adoption of RocketMQ within its massive microservice ecosystem, explaining the business challenges, reasons for choosing RocketMQ, the proxy‑based deployment architecture, encountered technical issues, and the multi‑datacenter disaster‑recovery strategies implemented to ensure high availability and performance.
This article explains the Redis concurrent key competition problem, illustrates typical scenarios where multiple clients modify the same key, and presents four practical solutions—optimistic locking with WATCH/EXEC, distributed locks, timestamp ordering, and message‑queue serialization—to ensure data correctness under high concurrency.
This article examines five common Java backend pitfalls that startups face—single‑machine locking, improper multithreading, poorly defined workflows, unsafe system interactions, and non‑paginated queries—explains why they cause failures in distributed environments, and provides practical solutions such as distributed locks, message queues, state‑machine redesign, RPC interfaces, and pagination techniques.
