BestHub
Sign in
Tagged articles

Message Queue

1036 articles · Page 9 of 11
Top Architect
Top Architect
Aug 11, 2020 · Big Data

Kafka Basics and Cluster Architecture Overview

This article provides a comprehensive introduction to Kafka, covering its role as a messaging system, core concepts such as topics, partitions, producers, consumers, and messages, and then delves into the cluster architecture including replicas, consumer groups, controller coordination with Zookeeper, performance optimizations, log segmentation, and network design.

Cluster ArchitectureKafkaMessage Queue
0 likes · 11 min read
Kafka Basics and Cluster Architecture Overview
Open Source Linux
Open Source Linux
Aug 11, 2020 · Backend Development

Build a Docker‑Based Kafka Cluster and Integrate It with Spring Boot

This guide walks you through creating a three‑node Kafka cluster with Zookeeper using Docker‑Compose, configuring the necessary YAML, launching the containers, and then integrating the cluster into a Spring Boot application by adding dependencies, setting Kafka properties, defining message, sender, and receiver classes, and testing the message flow.

DockerDocker ComposeKafka
0 likes · 6 min read
Build a Docker‑Based Kafka Cluster and Integrate It with Spring Boot
JavaEdge
JavaEdge
Aug 5, 2020 · Backend Development

How to Diagnose and Resolve Message Queue Backlog Issues

Message backlog in MQ systems can cripple performance; this guide explains why backlogs occur, how to trace their root causes, and practical producer‑ and consumer‑side optimizations—including batching, concurrency, partition scaling, and dead‑letter handling—to restore throughput and prevent future congestion.

ConsumerMessage QueueOptimization
0 likes · 11 min read
How to Diagnose and Resolve Message Queue Backlog Issues
IT Architects Alliance
IT Architects Alliance
Jul 29, 2020 · Backend Development

How to Decouple Microservices: From Sync Calls to Event‑Driven Architecture

The article examines why tightly coupled microservices cause reliability issues, then presents practical techniques—such as converting synchronous calls to asynchronous messaging, adopting event‑driven architecture, using CQRS, caching, and strategic refactoring—to achieve loose coupling and improve system resilience.

CQRSDecouplingMessage Queue
0 likes · 21 min read
How to Decouple Microservices: From Sync Calls to Event‑Driven Architecture
JavaEdge
JavaEdge
Jul 24, 2020 · Backend Development

Designing High‑Concurrency Systems: Key Strategies Interviewers Expect

This guide explains practical techniques—service splitting, caching, message queues, database sharding, read/write separation, and Elasticsearch—to design high‑concurrency back‑end systems that impress interviewers and handle real‑world traffic spikes.

Message QueueSystem Designcaching
0 likes · 6 min read
Designing High‑Concurrency Systems: Key Strategies Interviewers Expect
Big Data Technology & Architecture
Big Data Technology & Architecture
Jul 23, 2020 · Big Data

Comprehensive Kafka FAQ: Uses, Architecture, Offsets, and Partition Management

This article provides an extensive overview of Apache Kafka, covering its use cases, key concepts such as ISR, AR, HW, LEO, and LW, message ordering, the roles of partitioners, serializers and interceptors, producer and consumer client architecture, offset handling, multithreaded consumption, and topic partition management.

Big DataKafkaMessage Queue
0 likes · 16 min read
Comprehensive Kafka FAQ: Uses, Architecture, Offsets, and Partition Management
dbaplus Community
dbaplus Community
Jul 15, 2020 · Backend Development

Why RocketMQ Throws TIMEOUT_CLEAN_QUEUE: Deep Dive into Broker Fast-Failure Bug

The article examines a recurring RocketMQ error (TIMEOUT_CLEAN_QUEUE) caused by the broker’s fast‑failure mechanism, explains how the broker queues and thread pools operate, reveals that SYSTEM_BUSY is mistakenly excluded from retry logic—a bug—and proposes both a temporary configuration tweak and a permanent code fix via a PR.

BrokerFast-FailureMessage Queue
0 likes · 8 min read
Why RocketMQ Throws TIMEOUT_CLEAN_QUEUE: Deep Dive into Broker Fast-Failure Bug
Architects Research Society
Architects Research Society
Jul 15, 2020 · Big Data

Introduction to Apache Kafka: A Distributed Streaming Platform

This article provides a comprehensive overview of Apache Kafka, explaining its distributed, fault‑tolerant architecture, horizontal scalability, disk‑based commit log, replication mechanisms, Streams API, KSQL, and why it is widely adopted as the backbone of event‑driven, high‑throughput systems.

KafkaMessage QueueStreaming
0 likes · 15 min read
Introduction to Apache Kafka: A Distributed Streaming Platform
Selected Java Interview Questions
Selected Java Interview Questions
Jul 10, 2020 · Backend Development

Message Queue Interview Questions and Technical Guide

This article provides a comprehensive overview of message queue concepts, covering usage scenarios, advantages, drawbacks, technology selection, high‑availability architectures, duplicate handling, data loss prevention, ordering guarantees, latency management, and design principles, supplemented with interview‑style questions and code examples.

KafkaMQMessage Queue
0 likes · 20 min read
Message Queue Interview Questions and Technical Guide
Ctrip Technology
Ctrip Technology
Jul 9, 2020 · Backend Development

Lessons from QMQ: Network and Disk I/O Problems and Their Mitigations

The article analyzes real‑world network and disk I/O issues encountered in Qunar Message Queue (QMQ), explains root causes such as Netty OOM, file‑handle exhaustion, TCP timeout handling, and large‑traffic bursts, and presents practical mitigation strategies for backend systems.

Message QueueNetwork IOPerformance Tuning
0 likes · 11 min read
Lessons from QMQ: Network and Disk I/O Problems and Their Mitigations
Selected Java Interview Questions
Selected Java Interview Questions
Jul 8, 2020 · Backend Development

Message Queue Applications and Comparison of Common MQs (ActiveMQ, RabbitMQ, RocketMQ, Kafka)

This article explains the role of message queues in distributed systems, illustrates four typical scenarios—asynchronous processing, application decoupling, traffic shaping, and message communication—and compares the features of popular middleware such as ActiveMQ, RabbitMQ, RocketMQ, and Kafka.

KafkaMessage QueueSystem Architecture
0 likes · 9 min read
Message Queue Applications and Comparison of Common MQs (ActiveMQ, RabbitMQ, RocketMQ, Kafka)
Top Architect
Top Architect
Jul 7, 2020 · Backend Development

Consumer‑Side Rate Limiting, TTL, and Dead Letter Queues in RabbitMQ

This article explains why consumer‑side flow control is needed in RabbitMQ, demonstrates how to use the QoS API and basicQos settings, shows practical Java code for limiting consumption, and covers TTL and dead‑letter queue configurations to improve message reliability and system stability.

Consumer Rate LimitingDead Letter QueueJava
0 likes · 15 min read
Consumer‑Side Rate Limiting, TTL, and Dead Letter Queues in RabbitMQ
Programmer DD
Programmer DD
Jul 1, 2020 · Backend Development

Mastering RabbitMQ Consumer Flow Control, TTL, and Dead‑Letter Queues

This article explains why and how to throttle RabbitMQ consumers using QoS settings, demonstrates practical Java code for consumer‑side flow control, explores message and queue TTL configurations, and details the setup of dead‑letter exchanges and queues to handle undelivered messages.

Dead Letter QueueJavaMessage Queue
0 likes · 13 min read
Mastering RabbitMQ Consumer Flow Control, TTL, and Dead‑Letter Queues
Top Architect
Top Architect
Jun 29, 2020 · Backend Development

Using RocketMQ for Traffic Shaping in Spring Boot: Configuration, Code Samples, and Performance Tuning

This article explains how to use RocketMQ for traffic‑shaping in a Spring Boot application, covering its core components, consumer pull configuration, integration via rocketmq‑spring‑boot‑starter, a practical like‑praise use case, a Maven setup, YAML configuration, and advanced topics such as dynamic scaling and batch consumption.

JavaMessage QueueRocketMQ
0 likes · 15 min read
Using RocketMQ for Traffic Shaping in Spring Boot: Configuration, Code Samples, and Performance Tuning
Open Source Tech Hub
Open Source Tech Hub
Jun 25, 2020 · Backend Development

Mastering Redis: Core Data Structures and Practical Commands Explained

This comprehensive guide explores Redis fundamentals, detailing its six primary data structures—strings, lists, hashes, sets, sorted sets, and streams—along with practical command examples, internal implementations, and usage patterns for high‑performance backend development.

CacheData StructuresMessage Queue
0 likes · 17 min read
Mastering Redis: Core Data Structures and Practical Commands Explained
Java Architect Essentials
Java Architect Essentials
Jun 22, 2020 · Operations

ActiveMQ Message Queue Optimization: Removing Synchronized Lock and Tuning queuePrefetch

This article analyzes a severe ActiveMQ message‑queue backlog caused by a synchronized onMessage listener, then demonstrates how removing the lock and tuning the queuePrefetch parameter, along with a dual‑queue redesign, can boost consumption throughput by over thirty times, eliminating the data pile‑up.

ActiveMQMessage QueuePerformance Tuning
0 likes · 8 min read
ActiveMQ Message Queue Optimization: Removing Synchronized Lock and Tuning queuePrefetch
Architect
Architect
Jun 18, 2020 · Backend Development

Applying Message Queues for Decoupling in E‑commerce Architecture

The article explains why and how to use message queues to achieve low‑coupling, better performance, fault tolerance, and eventual consistency in an e‑commerce order‑processing flow, discusses common pitfalls such as message loss and duplication, and compares popular queue products like RabbitMQ, Kafka, and RocketMQ.

DecouplingEventual ConsistencyKafka
0 likes · 10 min read
Applying Message Queues for Decoupling in E‑commerce Architecture
Jike Tech Team
Jike Tech Team
Jun 11, 2020 · Fundamentals

Unlocking the Secrets of AMQP: A Deep Dive into Message Queuing Protocol

This article explores the AMQP 0.9.1 protocol in depth, covering its core concepts, model components, layered architecture, lifecycle of exchanges, queues, channels, and bindings, as well as command classes, transport details, and practical usage patterns for building robust messaging systems.

AMQPMessage QueueMessaging Architecture
0 likes · 29 min read
Unlocking the Secrets of AMQP: A Deep Dive into Message Queuing Protocol
macrozheng
macrozheng
Jun 11, 2020 · Backend Development

How to Implement RabbitMQ Delayed Messages with the Delayed Plugin in Spring Boot

This guide walks through installing the RabbitMQ delayed‑message‑exchange plugin, configuring it in a Spring Boot application, and building Java components to send and receive delayed order‑cancellation messages, comparing the plugin approach with dead‑letter queues and providing complete code snippets and deployment steps.

Message QueuePluginSpring Boot
0 likes · 12 min read
How to Implement RabbitMQ Delayed Messages with the Delayed Plugin in Spring Boot
Full-Stack Internet Architecture
Full-Stack Internet Architecture
Jun 10, 2020 · Backend Development

Understanding Kafka Consumer Groups, Repartition Triggers, and Consumption Guarantees

This article explains the relationship between Kafka consumers and consumer groups, when repartition occurs, how consumers interact with Zookeeper, the overall consumer workflow, and the three delivery semantics (at‑least‑once, at‑most‑once, exactly‑once) in a concise, technical overview.

Consumer GroupKafkaMessage Queue
0 likes · 8 min read
Understanding Kafka Consumer Groups, Repartition Triggers, and Consumption Guarantees
Big Data Technology & Architecture
Big Data Technology & Architecture
Jun 4, 2020 · Big Data

Kafka for Data Ingestion and Event Distribution: Production‑Consumer and Publish‑Subscribe Patterns

This article explains how Kafka can be used for data ingestion and event distribution by illustrating production‑consumer and publish‑subscribe models, describing core concepts such as topics, partitions and consumer groups, and offering practical design options for handling different event scenarios.

Big DataData IngestionEvent Distribution
0 likes · 9 min read
Kafka for Data Ingestion and Event Distribution: Production‑Consumer and Publish‑Subscribe Patterns
Programmer DD
Programmer DD
May 28, 2020 · Backend Development

How to Use RocketMQ for Traffic Shaping and Peak‑Smoothing in Spring Boot

This article explains how RocketMQ’s decoupling, asynchronous and peak‑shaving features can be applied in a Spring Boot project to buffer massive like‑click traffic, reduce database pressure, and dynamically tune consumer pull parameters for optimal throughput.

Consumer ConfigurationMessage QueuePeak Shaving
0 likes · 14 min read
How to Use RocketMQ for Traffic Shaping and Peak‑Smoothing in Spring Boot
Architects' Tech Alliance
Architects' Tech Alliance
May 27, 2020 · Fundamentals

Message Queue Overview, Models, and Comparison of ActiveMQ, RabbitMQ, RocketMQ, and Kafka

This article introduces the fundamentals of message queues, explains their characteristics, delivery models, transmission modes, and push‑pull patterns, then compares four popular implementations—ActiveMQ, RabbitMQ, RocketMQ, and Kafka—highlighting each system's strengths, weaknesses, deployment requirements, and typical use cases.

ActiveMQKafkaMessage Queue
0 likes · 17 min read
Message Queue Overview, Models, and Comparison of ActiveMQ, RabbitMQ, RocketMQ, and Kafka
macrozheng
macrozheng
May 21, 2020 · Big Data

Mastering Kafka: Core Concepts, Architecture, and Reliability Guarantees

This comprehensive guide covers Kafka's definition, publish/subscribe model, key components, storage mechanisms, producer and consumer strategies, and reliability features such as ACK levels, ISR, and exactly‑once semantics, providing a solid foundation for real‑time big‑data processing.

Big DataKafkaMessage Queue
0 likes · 16 min read
Mastering Kafka: Core Concepts, Architecture, and Reliability Guarantees
Youzan Coder
Youzan Coder
May 20, 2020 · Backend Development

Real-Time Loss Prevention System: Architecture and Implementation at YouZan

YouZan’s real‑time loss‑prevention platform monitors database binlogs, transforms and verifies transaction data across five loosely coupled layers, handling 200 million daily messages and 60 million checks with dynamic sharding, caching and distributed locks to detect over‑charges, duplicate refunds, migration inconsistencies and unauthorized data changes.

HBaseMessage QueueSharding Strategy
0 likes · 12 min read
Real-Time Loss Prevention System: Architecture and Implementation at YouZan
Architecture Digest
Architecture Digest
May 16, 2020 · Backend Development

RocketMQ Producer and Consumer Best Practices and Configuration Guide

This article provides a comprehensive guide to using RocketMQ, covering producer and consumer message handling, tag and key usage, logging, failure retry strategies, oneway sending, broker roles, name server addressing, client configuration, JVM and Linux kernel tuning, and practical code examples.

ConfigurationConsumerMessage Queue
0 likes · 19 min read
RocketMQ Producer and Consumer Best Practices and Configuration Guide
Top Architect
Top Architect
May 14, 2020 · Big Data

Kafka Overview, Architecture, Installation, and Operational Guide

This article provides a comprehensive introduction to Kafka, covering its definition, message queue concepts, architecture components, installation steps, configuration details, startup procedures, operational commands, producer and consumer mechanisms, reliability guarantees, partition strategies, offset management, and performance optimizations.

Big DataConsumerInstallation
0 likes · 22 min read
Kafka Overview, Architecture, Installation, and Operational Guide
Programmer DD
Programmer DD
May 12, 2020 · Operations

Boost RabbitMQ Reliability: Proven Strategies for Producers, Consumers, and Ops

This comprehensive guide explains how to enhance RabbitMQ reliability by covering confirmation mechanisms, producer and consumer configurations, queue mirroring, alerting, monitoring metrics, and health‑check commands, providing actionable steps for developers and operations teams to ensure stable message delivery.

Message QueueMonitoringReliability
0 likes · 22 min read
Boost RabbitMQ Reliability: Proven Strategies for Producers, Consumers, and Ops
Architecture Digest
Architecture Digest
May 3, 2020 · Big Data

Kafka Concept Overview

This article provides a comprehensive introduction to Kafka, covering its definition, message‑queue models, architecture components, installation steps, configuration details, producer and consumer mechanisms, reliability guarantees, partition assignment strategies, offset management, and high‑performance read/write techniques.

Big DataConsumerKafka
0 likes · 20 min read
Kafka Concept Overview
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Apr 26, 2020 · Backend Development

How to Build a Million‑Message‑Per‑Second RabbitMQ Cluster: Lessons from Google

This article explains how to design and scale a RabbitMQ cluster capable of handling millions of messages per second, covering core concepts, Google’s large‑scale test setup, sharding and federation plugins, mirror queues, reliability mechanisms, and practical tips for high‑availability and performance optimization.

ClusteringMessage QueueScaling
0 likes · 25 min read
How to Build a Million‑Message‑Per‑Second RabbitMQ Cluster: Lessons from Google
Java Captain
Java Captain
Apr 9, 2020 · Backend Development

Introduction to RabbitMQ: Overview, Use Cases, Advantages, and Drawbacks

This article introduces RabbitMQ, explains its core concepts and AMQP protocol, outlines common scenarios such as decoupling, asynchronous processing, and traffic shaping, and discusses the benefits and challenges of integrating a message queue into backend architectures.

AMQPAsynchronousDecoupling
0 likes · 8 min read
Introduction to RabbitMQ: Overview, Use Cases, Advantages, and Drawbacks
Qunar Tech Salon
Qunar Tech Salon
Apr 9, 2020 · Backend Development

RabbitMQ vs Kafka: Key Differences and How to Choose Between Them

This article compares RabbitMQ and Apache Kafka across architecture, message ordering, routing, timing, retention, fault handling, scalability, and consumer complexity, providing guidance on when to prefer each system based on functional and non‑functional requirements.

ComparisonKafkaMessage Queue
0 likes · 17 min read
RabbitMQ vs Kafka: Key Differences and How to Choose Between Them
Programmer DD
Programmer DD
Mar 28, 2020 · Backend Development

Why Is Kafka So Fast? Uncover the 11 Performance Secrets

Kafka achieves its remarkable speed by combining sequential I/O, batch processing, compression, zero‑copy, careful client‑side work, and a design that avoids costly fsync and garbage collection, while maintaining durability, ordering, and at‑least‑once delivery, making it a high‑throughput, low‑latency event streaming platform.

Batch ProcessingKafkaMessage Queue
0 likes · 15 min read
Why Is Kafka So Fast? Uncover the 11 Performance Secrets
Qunar Tech Salon
Qunar Tech Salon
Mar 19, 2020 · Big Data

Apache Kafka Overview: Architecture, Features, and Usage

This article provides a comprehensive introduction to Apache Kafka, covering its high‑throughput distributed architecture, core concepts such as topics, partitions, brokers, producers and consumers, design goals, performance characteristics, deployment steps, configuration, and example code for producers, consumers, and Spring Boot integration.

Big DataKafkaMessage Queue
0 likes · 39 min read
Apache Kafka Overview: Architecture, Features, and Usage
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Mar 4, 2020 · Big Data

Understanding Kafka: Core Concepts, Architecture, and Performance Secrets

This article introduces Kafka's role as a message system, explains its fundamental components such as topics, partitions, producers, consumers, and replicas, and dives into cluster architecture, consumer groups, Zookeeper coordination, and performance optimizations like sequential writes, zero‑copy, log segmentation, and network design.

KafkaMessage Queueperformance
0 likes · 13 min read
Understanding Kafka: Core Concepts, Architecture, and Performance Secrets
Big Data Technology & Architecture
Big Data Technology & Architecture
Feb 27, 2020 · Fundamentals

Message Queue Usage, Advantages, Disadvantages, and High‑Availability Design

The article explains why message queues are used, outlines their core scenarios—decoupling, asynchronous processing, and traffic shaping—compares Kafka, ActiveMQ, RabbitMQ, and RocketMQ, and details how to ensure high availability, reliability, idempotency, ordering, and scalability in production systems.

KafkaMessage Queueidempotency
0 likes · 34 min read
Message Queue Usage, Advantages, Disadvantages, and High‑Availability Design
Architecture Digest
Architecture Digest
Feb 24, 2020 · Backend Development

Understanding RocketMQ Transaction Messages with Code Examples

This article explains RocketMQ's transaction message feature, covering core concepts, the execution flow, and provides complete Java code examples for an order service and a product service that demonstrate how distributed transactions are implemented and verified.

JavaMessage QueueRocketMQ
0 likes · 9 min read
Understanding RocketMQ Transaction Messages with Code Examples
360 Tech Engineering
360 Tech Engineering
Feb 21, 2020 · Backend Development

Understanding Message Middleware: Queue and Publish‑Subscribe Styles

This article explains how modern message middleware works by describing the two primary communication styles—message queuing and publish‑subscribe—illustrating each with examples, comparing their characteristics, and listing common middleware products to help developers choose the appropriate solution for their backend systems.

Message BrokerMessage QueuePublish-Subscribe
0 likes · 5 min read
Understanding Message Middleware: Queue and Publish‑Subscribe Styles
Tencent Cloud Developer
Tencent Cloud Developer
Feb 18, 2020 · Backend Development

Technical Overview of Tencent Cloud CKafka for High-Scale Online Classroom Messaging

Tencent Cloud CKafka powers Tencent Classroom’s pandemic‑era online teaching by replacing a custom queue with a high‑performance, highly available, partition‑based message bus that scales to millions of real‑time interactions, offers configurable replication and tuning for reliability, and integrates with big‑data and streaming tools for analytics.

CKafkaKafkaMessage Queue
0 likes · 15 min read
Technical Overview of Tencent Cloud CKafka for High-Scale Online Classroom Messaging
Java Captain
Java Captain
Feb 12, 2020 · Backend Development

Comprehensive Comparison of Kafka, RabbitMQ, ZeroMQ, RocketMQ, and ActiveMQ

This article provides a detailed side‑by‑side comparison of five popular message‑queue systems—Kafka, RabbitMQ, ZeroMQ, RocketMQ and ActiveMQ—covering documentation, supported languages, protocols, storage, transactions, load balancing, clustering, management interfaces, availability, throughput, subscription models, ordering, acknowledgments, replay, retry, concurrency and more.

ActiveMQComparisonKafka
0 likes · 21 min read
Comprehensive Comparison of Kafka, RabbitMQ, ZeroMQ, RocketMQ, and ActiveMQ
Big Data Technology & Architecture
Big Data Technology & Architecture
Feb 11, 2020 · Backend Development

Message Queue Interview Guide: Benefits, Drawbacks, High Availability, Idempotency, Ordering and Design Strategies

This article provides a comprehensive interview‑oriented overview of message queues, explaining why they are used, their core advantages and disadvantages, comparing Kafka, RabbitMQ, ActiveMQ and RocketMQ, and detailing high‑availability, reliability, idempotency, ordering, backlog handling and architectural design considerations.

KafkaMessage Queueidempotency
0 likes · 33 min read
Message Queue Interview Guide: Benefits, Drawbacks, High Availability, Idempotency, Ordering and Design Strategies
Architecture Digest
Architecture Digest
Jan 18, 2020 · Backend Development

Comprehensive Comparison of Kafka, RabbitMQ, ZeroMQ, RocketMQ, and ActiveMQ Across 17 Aspects

This article provides a detailed side‑by‑side comparison of five popular message‑queue systems—Kafka, RabbitMQ, ZeroMQ, RocketMQ and ActiveMQ—covering documentation, language support, protocols, storage, transactions, load balancing, clustering, management UI, availability, duplication handling, throughput, subscription models, ordering, acknowledgments, replay, retry mechanisms and concurrency.

KafkaMessage Queuerabbitmq
0 likes · 25 min read
Comprehensive Comparison of Kafka, RabbitMQ, ZeroMQ, RocketMQ, and ActiveMQ Across 17 Aspects
Big Data Technology & Architecture
Big Data Technology & Architecture
Jan 16, 2020 · Big Data

Kafka Interview Guide: Core Concepts, Architecture, and Practical Tips

This article compiles essential Kafka interview material, covering its role as a message queue, usage scenarios, architectural components, storage mechanisms, consumer group rebalancing, high‑availability features, replication details, ordering guarantees, producer/consumer client design, topic management, log retention, performance optimizations, and key monitoring metrics.

Big DataKafkaMessage Queue
0 likes · 16 min read
Kafka Interview Guide: Core Concepts, Architecture, and Practical Tips
21CTO
21CTO
Jan 14, 2020 · Operations

How ByteDance Scaled RocketMQ with Proxies for High‑Performance Messaging and Disaster Recovery

This article details ByteDance's (今日头条) migration to RocketMQ, explaining the business drivers, the reasons for choosing RocketMQ, the proxy‑based architecture for producers and consumers, performance gains, operational challenges, and the disaster‑recovery designs implemented to ensure high availability in a micro‑service environment.

Message QueueProxy ArchitectureRocketMQ
0 likes · 14 min read
How ByteDance Scaled RocketMQ with Proxies for High‑Performance Messaging and Disaster Recovery
360 Quality & Efficiency
360 Quality & Efficiency
Jan 7, 2020 · Backend Development

Scaling a Backend: From Single Server to Reverse Proxy, Load Balancing, Microservices, Caching, and Partitioning

This article explains how to evolve a simple single‑node backend by adding a reverse proxy, introducing load balancers, scaling databases, adopting micro‑services, leveraging caches and CDNs, using message queues, and applying partitioning techniques to handle massive traffic while maintaining consistency and reliability.

Message QueueScalingarchitecture
0 likes · 10 min read
Scaling a Backend: From Single Server to Reverse Proxy, Load Balancing, Microservices, Caching, and Partitioning
Tencent Cloud Developer
Tencent Cloud Developer
Jan 6, 2020 · Big Data

Overview of TubeMQ: Principles, Architecture, Performance, and Open‑Source Strategy for Big‑Data Message Queues

TubeMQ is a trillion‑level, Java‑based distributed message‑queue middleware designed for massive‑data ingestion, offering 140 k TPS with sub‑5 ms latency, high reliability, low cost, and horizontal scalability, and is being open‑sourced to the Apache foundation to foster community collaboration and future expansion beyond traditional MQ functions.

Big DataMessage QueueTubeMQ
0 likes · 15 min read
Overview of TubeMQ: Principles, Architecture, Performance, and Open‑Source Strategy for Big‑Data Message Queues
Big Data Technology & Architecture
Big Data Technology & Architecture
Dec 15, 2019 · Operations

Understanding RocketMQ: Architecture, Key Features, and Best Practices

This article provides a comprehensive overview of RocketMQ, covering its architecture, how it handles ordered and duplicate messages, transaction processing, producer and consumer mechanisms, storage design, subscription models, and practical best‑practice recommendations for building reliable distributed messaging systems.

DuplicationMessage QueueOrdering
0 likes · 23 min read
Understanding RocketMQ: Architecture, Key Features, and Best Practices
Java High-Performance Architecture
Java High-Performance Architecture
Dec 7, 2019 · Backend Development

How Zookeeper Powers Kafka: Key Roles Explained

This article explains how Zookeeper functions as an essential part of Kafka by managing broker status, controller election, quotas, ISR tracking, node and topic registration, as well as consumer offset storage and registration, providing a comprehensive overview for interview preparation.

BrokerConsumerKafka
0 likes · 4 min read
How Zookeeper Powers Kafka: Key Roles Explained
ITPUB
ITPUB
Dec 2, 2019 · Backend Development

How Xiaomi Built Talos: A Scalable, Stateless Message Queue for Billions of Events

This article details Xiaomi's journey from Kafka 0.8 to the home‑grown Talos system, covering business motivations, storage‑compute separation architecture, key challenges such as tail‑read and consistency, and extensive performance, resource, and platform optimizations that enable a high‑throughput, multi‑tenant messaging service.

Distributed MessagingHDFSMessage Queue
0 likes · 16 min read
How Xiaomi Built Talos: A Scalable, Stateless Message Queue for Billions of Events
Selected Java Interview Questions
Selected Java Interview Questions
Nov 21, 2019 · Backend Development

Message Queue Characteristics, Benefits, and Implementation in Distributed Systems

This article explains the fundamental properties of message queues, why they are needed, the advantages they bring such as improved response speed, stability, and decoupling, and discusses distributed system challenges and practical implementation considerations for selecting and deploying a suitable message‑queue solution.

Message Queueasynchronous processing
0 likes · 11 min read
Message Queue Characteristics, Benefits, and Implementation in Distributed Systems
Java Captain
Java Captain
Nov 20, 2019 · Backend Development

Exploring Advanced Features of Spring‑Kafka: Integration, Embedded Server, Topic Management, Transactions, and Message Handling

This article provides a comprehensive guide to using Spring‑Kafka, covering simple integration, embedded Kafka for testing, creating topics programmatically, advanced KafkaTemplate usage, transactional messaging, ReplyingKafkaTemplate for request‑reply, listener configurations, manual acknowledgments, lifecycle control, message forwarding, and retry with dead‑letter queues.

Embedded KafkaJavaKafka
0 likes · 19 min read
Exploring Advanced Features of Spring‑Kafka: Integration, Embedded Server, Topic Management, Transactions, and Message Handling
Programmer DD
Programmer DD
Nov 19, 2019 · Backend Development

17‑Point Comparison: Kafka vs RabbitMQ vs ZeroMQ vs RocketMQ vs ActiveMQ

This article provides a comprehensive 17‑point comparison of five popular message queue systems—Kafka, RabbitMQ, ZeroMQ, RocketMQ, and ActiveMQ—covering documentation, supported languages, protocols, storage, transactions, load balancing, clustering, management UI, availability, message duplication, throughput, subscription models, ordering, acknowledgments, replay, retries, concurrency, and more.

ActiveMQKafkaMessage Queue
0 likes · 23 min read
17‑Point Comparison: Kafka vs RabbitMQ vs ZeroMQ vs RocketMQ vs ActiveMQ
21CTO
21CTO
Nov 9, 2019 · Backend Development

How ByteDance Scales RocketMQ for Microservices and Disaster Recovery

This article details ByteDance’s adoption of RocketMQ within its massive microservice ecosystem, explaining the business challenges, reasons for choosing RocketMQ, the proxy‑based deployment architecture, encountered technical issues, and the multi‑datacenter disaster‑recovery strategies implemented to ensure high availability and performance.

Message QueueProxy ArchitectureRocketMQ
0 likes · 15 min read
How ByteDance Scales RocketMQ for Microservices and Disaster Recovery
Java High-Performance Architecture
Java High-Performance Architecture
Nov 8, 2019 · Databases

How to Prevent Redis Key Race Conditions: Optimistic Locks, Distributed Locks, Timestamps & Queues

This article explains the Redis concurrent key competition problem, illustrates typical scenarios where multiple clients modify the same key, and presents four practical solutions—optimistic locking with WATCH/EXEC, distributed locks, timestamp ordering, and message‑queue serialization—to ensure data correctness under high concurrency.

Message Queueconcurrencydistributed lock
0 likes · 5 min read
How to Prevent Redis Key Race Conditions: Optimistic Locks, Distributed Locks, Timestamps & Queues
Alibaba Cloud Developer
Alibaba Cloud Developer
Nov 6, 2019 · Backend Development

Why Your Java Service Breaks When Scaling and How to Fix It

This article examines five common Java backend pitfalls that startups face—single‑machine locking, improper multithreading, poorly defined workflows, unsafe system interactions, and non‑paginated queries—explains why they cause failures in distributed environments, and provides practical solutions such as distributed locks, message queues, state‑machine redesign, RPC interfaces, and pagination techniques.

JavaMessage QueuePagination
0 likes · 22 min read
Why Your Java Service Breaks When Scaling and How to Fix It
Big Data Technology & Architecture
Big Data Technology & Architecture
Nov 3, 2019 · Backend Development

RocketMQ Practices and Disaster‑Recovery Architecture at ByteDance

This article summarizes Shen Hui’s presentation on how ByteDance adopted RocketMQ in a massive micro‑service environment, detailing the business background, reasons for choosing RocketMQ, the proxy‑based deployment, encountered challenges, and the multi‑data‑center disaster‑recovery solutions implemented.

Message QueueProxy ArchitectureRocketMQ
0 likes · 13 min read
RocketMQ Practices and Disaster‑Recovery Architecture at ByteDance
Big Data Technology & Architecture
Big Data Technology & Architecture
Oct 31, 2019 · Backend Development

Designing a High-Concurrency Flash Sale System Using Redis Caching and Lua Scripts

This article explains how to design a high‑concurrency flash‑sale (秒杀) system by leveraging browser and CDN caching, read‑write split Redis for traffic filtering, Lua scripts for atomic stock deduction, master‑slave Redis for fast inventory updates, and Redis‑based message queues for asynchronous order processing.

LuaMessage QueueRedis
0 likes · 8 min read
Designing a High-Concurrency Flash Sale System Using Redis Caching and Lua Scripts
macrozheng
macrozheng
Oct 18, 2019 · Backend Development

How Message Queues Boost Decoupling and Reliability in Production Systems

This article explains how using message queues for asynchronous communication decouples services, improves fault tolerance, and enhances performance, illustrated with a real‑world early‑education app case and a guide to employing dead‑letter queues for handling failed messages.

Dead Letter QueueDecouplingMessage Queue
0 likes · 9 min read
How Message Queues Boost Decoupling and Reliability in Production Systems
Programmer DD
Programmer DD
Oct 2, 2019 · Backend Development

How to Build a Reliable, Secure, and Scalable IM Server from Scratch

This article walks through constructing a lightweight instant‑messaging backend, covering version 1.0.0 features, reliability guarantees, application‑level ACK handling, security encryption, database schema for users, relations and offline messages, and storage strategies to prevent duplicate delivery.

Instant MessagingJavaMessage Queue
0 likes · 12 min read
How to Build a Reliable, Secure, and Scalable IM Server from Scratch
Programmer DD
Programmer DD
Sep 29, 2019 · Backend Development

Build a Scalable Instant Messaging Server from Scratch – IM1.0.0 Features Explained

This article walks through constructing a lightweight, feature‑rich instant‑messaging backend (IM1.0.0) that supports one‑to‑one text/file messaging, delivery/read receipts, LDAP login, horizontal scaling via connector and transfer modules, user‑status management with Redis, offline storage using MySQL and message queues, and outlines the overall architecture.

Instant MessagingMessage Queuedistributed systems
0 likes · 9 min read
Build a Scalable Instant Messaging Server from Scratch – IM1.0.0 Features Explained
58 Tech
58 Tech
Sep 24, 2019 · Operations

Master Election and Load Balancing in WMB Distributed Message Queue

The article explains how WMB, a high‑performance distributed message queue, uses Paxos‑based master election, periodic lease renewal, and a multi‑stage load‑balancing strategy to evenly distribute master nodes across groups, improve throughput, and ensure consistent message delivery.

Master ElectionMessage QueuePaxos
0 likes · 11 min read
Master Election and Load Balancing in WMB Distributed Message Queue
Architecture Digest
Architecture Digest
Aug 14, 2019 · Big Data

Kafka Overview: Architecture, Storage Mechanism, Replication, and Consumer/Producer Model

Kafka is a distributed, partitioned, replicated messaging system originally developed by LinkedIn, offering high throughput, low latency, fault tolerance, and scalability; this article explains its core concepts, file storage design, partition replication, leader election, consumer groups, delivery guarantees, and operational considerations for big‑data pipelines.

Big DataKafkaMessage Queue
0 likes · 56 min read
Kafka Overview: Architecture, Storage Mechanism, Replication, and Consumer/Producer Model
Qunar Tech Salon
Qunar Tech Salon
Aug 12, 2019 · Backend Development

QMQ: Design, Usage, and Implementation of Qunar's Distributed Message Queue

This article introduces QMQ, Qunar's internal distributed message queue, covering its background, design motivations, core concepts, code examples for producing and consuming both real‑time and delayed messages, transactional messaging support, and the overall architecture of its metaserver, broker, and delay components.

JavaMessage QueueQMQ
0 likes · 18 min read
QMQ: Design, Usage, and Implementation of Qunar's Distributed Message Queue
Architecture Digest
Architecture Digest
Aug 8, 2019 · Big Data

Kafka Practical Guide: Concepts, Architecture, Configuration, Monitoring, and Management

This article provides a comprehensive overview of Kafka, covering its basic concepts, architecture, deployment, configuration, monitoring, producer and consumer settings, offset management, high availability, replication, leader election, and practical tips for deployment, tuning, and troubleshooting in production environments.

KafkaMessage QueueOffset Management
0 likes · 37 min read
Kafka Practical Guide: Concepts, Architecture, Configuration, Monitoring, and Management
Open Source Tech Hub
Open Source Tech Hub
Aug 5, 2019 · Backend Development

How to Implement a Redis‑Backed Queue in ThinkPHP5

This guide explains how to set up ThinkPHP5's built‑in Queue component with a Redis driver, create a custom queue class, configure the queue, produce messages, and run a consumer process, including handling retries, delays, and daemon mode.

Message QueuePHPRedis
0 likes · 9 min read
How to Implement a Redis‑Backed Queue in ThinkPHP5
Big Data Technology Architecture
Big Data Technology Architecture
Aug 3, 2019 · Big Data

Kafka Architecture: Design Principles for High Throughput and Reliability

This article explains Kafka's design background, persistence mechanisms, disk sequential I/O optimizations, network and compression strategies, and stability features such as partitioning, replication, and ISR, illustrating how these techniques enable high‑throughput, low‑latency real‑time log processing in big‑data environments.

Disk I/OHigh throughputKafka
0 likes · 9 min read
Kafka Architecture: Design Principles for High Throughput and Reliability
NetEase Media Technology Team
NetEase Media Technology Team
Aug 2, 2019 · Backend Development

Delayed Message Queue Implementation: Use Cases, Comparison, and NetEase Open Course Practice

The article explains how delayed message queues replace inefficient scheduled‑task scans in distributed systems, outlines common use cases such as order timeouts and retries, compares RabbitMQ, RocketMQ, Kafka, ActiveMQ and Redis implementations, and details NetEase’s ActiveMQ‑based solution with idempotent processing and traceability.

ActiveMQKafkaMessage Queue
0 likes · 13 min read
Delayed Message Queue Implementation: Use Cases, Comparison, and NetEase Open Course Practice
FunTester
FunTester
Jul 23, 2019 · Operations

How to Load Test Dubbo Queue APIs with JMeter and Java Concurrency

This article explains a practical approach to performance‑testing Dubbo add and delete methods of a message queue by pre‑generating payloads, using a thread‑safe LinkedBlockingQueue, and driving the calls with JMeter‑compatible Java code.

DubboJavaMessage Queue
0 likes · 6 min read
How to Load Test Dubbo Queue APIs with JMeter and Java Concurrency
FunTester
FunTester
Jul 18, 2019 · Backend Development

Load Testing Dubbo Queue Service Using Java Concurrency and JMeter

This article describes how to conduct load testing of Dubbo queue service methods for adding and deleting messages using Java concurrency utilities and JMeter, including code examples for constructing test data, managing a thread‑safe LinkedBlockingQueue, and handling initialization challenges during repeated test runs.

DubboJavaMessage Queue
0 likes · 5 min read
Load Testing Dubbo Queue Service Using Java Concurrency and JMeter
Open Source Tech Hub
Open Source Tech Hub
Jul 17, 2019 · Fundamentals

Master AMQP: Key Terms and Concepts Every Developer Should Know

This guide defines and explains essential AMQP terminology—including virtual hosts, queues, exchanges, bindings, routing keys, producers, consumers, connections, and channels—to help developers grasp how message routing and queue management work in modern messaging systems.

AMQPExchangeMessage Queue
0 likes · 5 min read
Master AMQP: Key Terms and Concepts Every Developer Should Know
Youzan Coder
Youzan Coder
Jul 12, 2019 · Backend Development

How to Build NSQ Multi‑Data‑Center Deployment with Lookup‑Migrate

This article explains the design and implementation of NSQ dual‑ and multi‑data‑center architectures using a lookup‑migrate proxy, covering deployment scenarios, routing strategies, migration phases, JSON response transformations, and practical lessons learned for reliable message publishing and consumption across data centers.

Message QueueNSQbackend
0 likes · 13 min read
How to Build NSQ Multi‑Data‑Center Deployment with Lookup‑Migrate
Big Data Technology Architecture
Big Data Technology Architecture
Jul 12, 2019 · Big Data

Why Kafka Is So Popular: Features, Use Cases, and Architecture Overview

This article explains why Apache Kafka has become a cornerstone of modern big‑data pipelines by detailing its high‑throughput, fault‑tolerant publish‑subscribe architecture, real‑time processing capabilities, extensive language support, scalability mechanisms, and the wide range of use cases adopted by leading enterprises.

Distributed StreamingKafkaMessage Queue
0 likes · 9 min read
Why Kafka Is So Popular: Features, Use Cases, and Architecture Overview
Big Data Technology & Architecture
Big Data Technology & Architecture
Jul 3, 2019 · Backend Development

Deep Dive into Apache RocketMQ: Architecture, Routing, Storage, and High‑Availability Design

This article provides a comprehensive overview of Apache RocketMQ’s core architecture, including topic routing mechanisms, message storage file designs, high‑availability message sending, concurrent pull and consumption processes, HA synchronization, and transaction messaging, while offering practical learning steps and programming techniques for developers.

Message QueueRocketMQbackend development
0 likes · 14 min read
Deep Dive into Apache RocketMQ: Architecture, Routing, Storage, and High‑Availability Design
Big Data Technology & Architecture
Big Data Technology & Architecture
Jul 1, 2019 · Big Data

How to Ensure High Availability of Message Queues (RabbitMQ and Kafka)

This article explains the concept of high availability for message queues, analyzes interview expectations, and details the HA mechanisms of RabbitMQ (including single, normal cluster, and mirrored modes) and Kafka (partition replication and leader election), highlighting their advantages, drawbacks, and practical considerations.

KafkaMessage Queuedistributed systems
0 likes · 11 min read
How to Ensure High Availability of Message Queues (RabbitMQ and Kafka)
dbaplus Community
dbaplus Community
Jun 24, 2019 · Operations

Why Did Our Payment System Auto‑Recover? A Deep Dive into Queue Backlog and Transaction Locks

A new employee at an OTA company faced a mysterious outage where thousands of payment‑related messages piled up in the queue, the system auto‑recovered, and a detailed investigation revealed a stuck MySQL transaction caused by missing response timeout settings, leading to lock contention and message backlog.

HttpClientMessage Queueincident analysis
0 likes · 7 min read
Why Did Our Payment System Auto‑Recover? A Deep Dive into Queue Backlog and Transaction Locks
Architect's Tech Stack
Architect's Tech Stack
May 31, 2019 · Big Data

Kafka Architecture Overview: Producers, Consumers, Partitions, Replication, and Transactions

This article provides a comprehensive overview of Apache Kafka's architecture, covering topics such as producer and consumer workflows, partition and replica management, leader election, offset handling, message delivery semantics, transaction support, and file organization, illustrating how Kafka achieves high performance and scalability.

ConsumerKafkaMessage Queue
0 likes · 18 min read
Kafka Architecture Overview: Producers, Consumers, Partitions, Replication, and Transactions
DataFunTalk
DataFunTalk
May 27, 2019 · Big Data

Practical Applications and Ecosystem Integration of Apache Kafka

This article explores Apache Kafka’s evolution, core messaging and stream processing capabilities, typical use cases, internal storage mechanisms, API choices, and best practices for deploying Kafka on Kubernetes, providing readers with comprehensive guidance to assess suitability and implement effective Kafka solutions.

Apache KafkaKafka APIsKubernetes
0 likes · 16 min read
Practical Applications and Ecosystem Integration of Apache Kafka