BestHub
Sign in
Tagged articles

Message Queue

1036 articles · Page 10 of 11
Architect's Tech Stack
Architect's Tech Stack
May 21, 2019 · Backend Development

RabbitMQ Overview: Core Concepts, Usage Scenarios, Message Delivery Guarantees, and Common Interview Questions

This article explains what RabbitMQ is, why it is used, typical application scenarios, how to ensure reliable message publishing and consumption, the roles of sender and receiver acknowledgments, routing mechanisms, clustering options, advantages, drawbacks, and provides interview‑style Q&A with a keyword to obtain full answers.

Message Queueinterviewmessaging
0 likes · 4 min read
RabbitMQ Overview: Core Concepts, Usage Scenarios, Message Delivery Guarantees, and Common Interview Questions
58 Tech
58 Tech
Apr 9, 2019 · Backend Development

Optimizing Group Chat Performance in an Instant Messaging Backend

This article analyzes the challenges of scaling group chat in an instant messaging system and presents architectural optimizations—including shared message storage, periodic conversation list updates, offline count handling, and version‑based incremental sync—to reduce write and read amplification while improving overall performance.

Message QueueWrite Amplificationbackend optimization
0 likes · 12 min read
Optimizing Group Chat Performance in an Instant Messaging Backend
Java Captain
Java Captain
Apr 3, 2019 · Backend Development

Understanding Message Queues: Benefits, Use Cases, and Challenges

This article explains what a message queue (MQ) is, why it is needed beyond in‑memory Java queues, and how it enables decoupling, asynchronous processing, peak‑shaving and rate‑limiting, while also discussing high‑availability, data‑loss, and consumer‑side considerations.

DecouplingJavaMessage Queue
0 likes · 11 min read
Understanding Message Queues: Benefits, Use Cases, and Challenges
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Mar 25, 2019 · Backend Development

Designing a Message Queue: Architecture, Protocols, Storage, and Consumption Management

This article explores the fundamental design of a message queue system, covering overall architecture with producers, brokers, and consumers, key design considerations for the broker, communication protocols such as JMS and AMQP, storage options, and strategies for managing consumption relationships and advanced features.

Communication ProtocolConsumer ManagementMessage Queue
0 likes · 8 min read
Designing a Message Queue: Architecture, Protocols, Storage, and Consumption Management
Youzan Coder
Youzan Coder
Mar 15, 2019 · Backend Development

How to Build a Youzan‑Custom NSQ Client with Partitioning, Lookup, and Message Tracing

This guide explains how to construct a client library for Youzan's customized NSQ, covering workflow configuration, nsqd discovery via nsqlookupd, connection establishment, message publishing and consumption, ordered consumption, and the implementation of message tracing with concrete command syntax and response handling.

Client LibraryMessage QueueMessage Tracing
0 likes · 15 min read
How to Build a Youzan‑Custom NSQ Client with Partitioning, Lookup, and Message Tracing
Mafengwo Technology
Mafengwo Technology
Feb 21, 2019 · Backend Development

How MaFengWo Scaled Its Custom Travel Platform with Multi‑Order Grabbing and Real‑Time Matching

The article explains how MaFengWo built a custom travel transaction system that uses multi‑order distribution, a grab‑pool message queue, concurrency‑controlled locking, and long‑connection notifications to efficiently match personalized travel requests with multiple suppliers, boosting conversion rates and platform performance.

Concurrency ControlMessage Queuecustom travel
0 likes · 9 min read
How MaFengWo Scaled Its Custom Travel Platform with Multi‑Order Grabbing and Real‑Time Matching
JD Tech
JD Tech
Feb 11, 2019 · Backend Development

Optimizing JD Service Market's Plugin List Service: From Thread Scaling to a Unified Cache Layer

This article presents a comprehensive case study of how JD's Service Market improved the performance of its core "Available Plugin List" service by analyzing self‑optimizations, resolving external resource conflicts, designing a unified caching model, and implementing asynchronous cache construction using binlog and MQ, ultimately achieving a six‑fold traffic surge handling during peak events.

DatabaseMessage Queuebackend
0 likes · 12 min read
Optimizing JD Service Market's Plugin List Service: From Thread Scaling to a Unified Cache Layer
Java Backend Technology
Java Backend Technology
Jan 26, 2019 · Backend Development

Hidden Pitfalls of Adding a Message Queue to Your Architecture

While message queues can decouple services and smooth traffic spikes, they also introduce availability risks, stability problems like message loss or duplication, and distributed consistency challenges that require careful high‑availability design and reliable transaction strategies.

Distributed ConsistencyMQMessage Queue
0 likes · 6 min read
Hidden Pitfalls of Adding a Message Queue to Your Architecture
Didi Tech
Didi Tech
Jan 15, 2019 · Backend Development

DDMQ: Didi's Open‑Source Distributed Message Queue

Didi Mobility has open‑sourced DDMQ, an enterprise‑grade distributed message queue that delivers millisecond‑level latency and millions of messages per second, supports real‑time, delayed and transactional messages via RocketMQ/Kafka and RocksDB, offers multi‑language SDKs, flexible consumption, server‑side filtering, a unified console, and achieves five‑nine availability across Didi’s ride‑hailing, finance and delivery platforms.

DDMQDistributed MessagingMessage Queue
0 likes · 7 min read
DDMQ: Didi's Open‑Source Distributed Message Queue
Programmer DD
Programmer DD
Jan 15, 2019 · Backend Development

Mastering RocketMQ Transactional Messages for Distributed Consistency

This article explains how RocketMQ’s transactional message feature enables distributed transaction final consistency by using half messages, message check‑back, and defined transaction states, and provides complete Java code samples for producers, listeners, and consumer idempotency handling.

Distributed TransactionsJavaMessage Queue
0 likes · 10 min read
Mastering RocketMQ Transactional Messages for Distributed Consistency
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Jan 11, 2019 · Backend Development

RocketMQ Overview: Introduction, Evolution, Architecture, Key Features, and Application Scenarios

This article provides a comprehensive overview of RocketMQ, covering its origins and evolution, core architecture components, message domain model, essential features such as ordered delivery and deduplication, and typical use cases like traffic shaping, asynchronous decoupling, and distributed transaction messaging.

Message QueueMessaging MiddlewareRocketMQ
0 likes · 10 min read
RocketMQ Overview: Introduction, Evolution, Architecture, Key Features, and Application Scenarios
JD Retail Technology
JD Retail Technology
Jan 8, 2019 · Backend Development

Performance, Storage, Indexing, and Caching Design of JMQ4 Middleware

The article presents an in‑depth technical overview of JD's self‑developed JMQ middleware, detailing its performance improvements over previous versions, comparing write throughput with Kafka under synchronous and asynchronous scenarios, and explaining JMQ4's storage architecture, dense indexing, high‑performance I/O, and cache management strategies.

IndexingJMQMessage Queue
0 likes · 11 min read
Performance, Storage, Indexing, and Caching Design of JMQ4 Middleware
Programmer DD
Programmer DD
Jan 8, 2019 · Backend Development

How to Build a Reliable Message Service for Distributed Transactions

This article explains how to design and implement a reliable message service that ensures atomicity between upstream business transactions and downstream message delivery, using status management, callbacks, and scheduled tasks to achieve eventual consistency in distributed systems.

Distributed TransactionsEventual ConsistencyMessage Queue
0 likes · 9 min read
How to Build a Reliable Message Service for Distributed Transactions
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Dec 27, 2018 · Backend Development

Fundamentals of Message Queues: Producers, Consumers, Brokers, and Messaging Models

This article explains the core concepts, components, design considerations, and common models of message queues—including point‑to‑point and publish/subscribe—while covering ordering, acknowledgment, transaction support, persistence, high availability, and practical selection guidance for high‑concurrency systems.

BrokerConsumerMessage Queue
0 likes · 8 min read
Fundamentals of Message Queues: Producers, Consumers, Brokers, and Messaging Models
Programmer DD
Programmer DD
Dec 16, 2018 · Cloud Native

Implementing Custom Error Handling in Spring Cloud Stream

This tutorial demonstrates how to create a custom error‑handling flow for Spring Cloud Stream by building a simple producer‑consumer example, configuring input/output bindings, using @StreamListener to simulate a failure, and routing the exception to a @ServiceActivator fallback method, while also discussing version‑specific limitations.

JavaMessage QueueServiceActivator
0 likes · 7 min read
Implementing Custom Error Handling in Spring Cloud Stream
dbaplus Community
dbaplus Community
Dec 12, 2018 · Backend Development

How to Choose the Right Message Queue: RabbitMQ vs Kafka

This article examines the role of message‑queue middleware in high‑concurrency IM systems, compares popular open‑source options such as ActiveMQ, RabbitMQ, Kafka, RocketMQ and ZeroMQ, and provides a detailed multi‑dimensional framework—including functionality, performance, reliability, operational management, and ecosystem factors—to help engineers select the most suitable queue for their specific business needs.

KafkaMessage QueueMiddleware Selection
0 likes · 28 min read
How to Choose the Right Message Queue: RabbitMQ vs Kafka
Manbang Technology Team
Manbang Technology Team
Dec 12, 2018 · Big Data

Kafka Overview: Core Concepts, Architecture, Configuration, and Usage in Real-Time Computing

This article provides a comprehensive technical overview of Kafka, covering its core concepts, producer and consumer models, architecture, configuration parameters, replication mechanisms, performance optimizations, operational monitoring, tooling scripts, and related product implementations for real-time data processing.

Big DataKafkaMessage Queue
0 likes · 18 min read
Kafka Overview: Core Concepts, Architecture, Configuration, and Usage in Real-Time Computing
Tencent Cloud Developer
Tencent Cloud Developer
Dec 7, 2018 · Cloud Native

29 Top Tools for Building Microservices on All Levels

The article surveys thirty‑nine essential open‑source tools for constructing microservices—from API management, messaging, and monitoring to Kubernetes orchestration, programming languages, frameworks, and serverless platforms—highlighting how each solution supports communication, scalability, and rapid development across enterprise, government, education, and charitable applications.

API ManagementContainer OrchestrationKubernetes
0 likes · 13 min read
29 Top Tools for Building Microservices on All Levels
dbaplus Community
dbaplus Community
Dec 6, 2018 · Backend Development

Mastering RabbitMQ: Core Concepts, Patterns, and Advanced Features

This article provides a comprehensive guide to RabbitMQ, covering the fundamentals of message middleware, the P2P and Pub/Sub models, a comparison with Kafka and RocketMQ, detailed explanations of exchanges, queues, channels, and advanced features such as mandatory routing, backup exchanges, TTL, dead‑letter queues, delayed queues, priority queues, and RPC implementations for reliable distributed systems.

Dead Letter QueueMessage QueueMessaging Patterns
0 likes · 23 min read
Mastering RabbitMQ: Core Concepts, Patterns, and Advanced Features
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Nov 29, 2018 · Databases

An Overview of Redis: Data Types, Features, Persistence, Clustering, and Use Cases

Redis is an open-source, in‑memory key‑value store written in C that supports multiple data structures, offers high‑performance caching, persistence via RDB and AOF, various clustering solutions such as Codis and native Redis Cluster, and is widely used for caching, ranking, session management, queues, and pub/sub.

In-Memory DatabaseMessage QueuePersistence
0 likes · 7 min read
An Overview of Redis: Data Types, Features, Persistence, Clustering, and Use Cases
Didi Tech
Didi Tech
Nov 20, 2018 · Operations

Didi's Message Queue Architecture, Migration Strategies, and RocketMQ Operational Practices

At Didi, the team replaced a chaotic mix of Kafka, Redis, and other queues with a custom, RocketMQ‑based service, using dual‑write and dual‑read migration, extensive performance testing, custom failover, batch extensions, and operational tweaks to achieve stable high‑throughput, low‑latency messaging at massive scale.

Message QueueRocketMQSystem Migration
0 likes · 17 min read
Didi's Message Queue Architecture, Migration Strategies, and RocketMQ Operational Practices
Architect's Tech Stack
Architect's Tech Stack
Nov 12, 2018 · Backend Development

Designing a High-Concurrency Flash Sale System with Redis Caching and Lua Scripts

This article explains how to build a high‑concurrency flash‑sale (秒杀) system by separating static page traffic with CDN, using read‑write‑split Redis for early request filtering, applying Lua scripts for atomic inventory deduction, and employing Redis as a simple message queue for asynchronous order persistence.

LuaMessage QueueRedis
0 likes · 9 min read
Designing a High-Concurrency Flash Sale System with Redis Caching and Lua Scripts
Java Backend Technology
Java Backend Technology
Nov 12, 2018 · Backend Development

Why Didi Chose RocketMQ: Lessons from Building a Scalable Message Queue Service

This article recounts Didi's journey from a chaotic mix of Kafka, RocketMQ, Redis, and other queues to a unified, high‑performance messaging platform built on Apache RocketMQ, covering the reasons for abandoning Kafka, the architecture evolution, migration strategies, performance benchmarks, and operational enhancements.

Kafka migrationMessage QueueRocketMQ
0 likes · 17 min read
Why Didi Chose RocketMQ: Lessons from Building a Scalable Message Queue Service
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Nov 11, 2018 · Backend Development

Technical Architecture Behind Alibaba's Double 11 Flash Sale

The article analyzes the massive technical challenges of Alibaba's Double 11 flash‑sale event and explains how cloud elasticity, distributed messaging, containerization, real‑time data processing, AI, front‑end optimization, caching, monitoring, and database sharding together enable billions of transactions within minutes.

AlibabaCloud ComputingDouble 11
0 likes · 9 min read
Technical Architecture Behind Alibaba's Double 11 Flash Sale
Architects' Tech Alliance
Architects' Tech Alliance
Nov 7, 2018 · Backend Development

An Overview of Apache RocketMQ: Origin, Concept Model, Storage, Deployment, and Best Practices

This article introduces Apache RocketMQ by covering its origin, core concepts such as topics, producers and consumers, storage architecture with CommitLog and ConsumeQueue, deployment components like brokers and name servers, and practical best‑practice guidance for handling duplicates, ordering, and message replay.

ApacheDistributed MessagingMessage Queue
0 likes · 8 min read
An Overview of Apache RocketMQ: Origin, Concept Model, Storage, Deployment, and Best Practices
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Sep 23, 2018 · Fundamentals

Comparison of Mainstream Message Queue Products and Their Typical Use Cases

This article examines the core features, performance characteristics, and typical application scenarios of popular message queue middleware such as ZeroMQ, RabbitMQ, ActiveMQ, Redis, Kafka, and others, while also discussing when to adopt a message queue, its benefits like decoupling, eventual consistency, broadcasting, and flow control, and summarizing best‑practice guidelines.

Eventual ConsistencyMQ ComparisonMessage Queue
0 likes · 13 min read
Comparison of Mainstream Message Queue Products and Their Typical Use Cases
Big Data and Microservices
Big Data and Microservices
Sep 20, 2018 · Backend Development

Why Distributed Transactions Matter: Concepts, Scenarios, and Solutions

This article explains the fundamentals of distributed transactions, why they arise in modern micro‑service architectures, outlines the ACID properties, presents typical use cases such as payments and order processing, and compares common implementation approaches like 2PC, message‑based eventual consistency, and TCC.

2PCDistributed TransactionsMessage Queue
0 likes · 12 min read
Why Distributed Transactions Matter: Concepts, Scenarios, and Solutions
21CTO
21CTO
Sep 14, 2018 · Backend Development

How Message Queues Enable Near Real‑Time Incremental Indexing in Search Engines

This article examines the high‑real‑time requirements of incremental data ingestion for search engines, compares three update schemes, and details how adopting a Kafka subscription‑based message‑queue approach dramatically improves latency and flexibility for the Nuomi search framework.

KafkaMessage Queueincremental indexing
0 likes · 8 min read
How Message Queues Enable Near Real‑Time Incremental Indexing in Search Engines
Architecture Digest
Architecture Digest
Sep 10, 2018 · Backend Development

Low‑Latency and High‑Availability Design of RocketMQ for Double‑11 Peak Traffic

This article reviews the evolution of Alibaba's Aliware message engine, analyzes the latency and availability challenges faced during Double‑11, and describes the low‑latency optimizations, capacity‑guarantee strategies, and multi‑replica high‑availability architecture implemented in RocketMQ to sustain trillion‑level message flows.

Message QueueRocketMQcapacity planning
0 likes · 22 min read
Low‑Latency and High‑Availability Design of RocketMQ for Double‑11 Peak Traffic
Architects' Tech Alliance
Architects' Tech Alliance
Aug 19, 2018 · Backend Development

Evolution of System Architecture: From LAMP to Distributed Services and Service Governance

This article outlines the progressive evolution of system architecture—from a single‑server LAMP setup through service and data separation, caching, clustering, read/write splitting, CDN, distributed storage, NoSQL, business decomposition, and finally distributed services with messaging, service frameworks, and governance—highlighting the motivations, characteristics, and challenges at each stage.

Message QueueService GovernanceSystem Architecture
0 likes · 12 min read
Evolution of System Architecture: From LAMP to Distributed Services and Service Governance
Java High-Performance Architecture
Java High-Performance Architecture
Jul 21, 2018 · Databases

Master Redis Streams: From Simple Adds to Powerful Consumer Groups

This guide walks through Redis 5's stream feature, showing how to set up a Docker Redis instance, add entries, perform range queries, use blocking reads, create and manage consumer groups, handle pending messages, claim ownership, inspect stream metadata, delete entries, and limit stream length for efficient message queue implementations.

DatabaseMessage QueueStreams
0 likes · 10 min read
Master Redis Streams: From Simple Adds to Powerful Consumer Groups
System Architect Go
System Architect Go
Jul 8, 2018 · Backend Development

Overview of NSQ: Architecture, Components, and Usage

NSQ is a lightweight, high‑performance open‑source message queue written in Go, and this article explains its core components (nsqd, nsqlookupd, nsqadmin, utilities), message flow architecture, configuration details, deployment recommendations, and additional considerations such as persistence, delivery guarantees, and scalability.

Message QueueNSQdistributed systems
0 likes · 5 min read
Overview of NSQ: Architecture, Components, and Usage
AntTech
AntTech
Jul 3, 2018 · Backend Development

Evolution of Financial‑Grade Message Queues at Ant Financial

The article reviews the ten‑year evolution of Ant Financial's message queue, detailing its core reliability, consistency, availability and performance requirements, the architectural mechanisms built to meet them, the shift to pull‑mode and API‑mode designs, and the recent integration of compute capabilities to create a smart data transmission platform.

Big DataMessage QueueReliability
0 likes · 13 min read
Evolution of Financial‑Grade Message Queues at Ant Financial
Java Captain
Java Captain
Jun 29, 2018 · Backend Development

Introduction to Message Queue Middleware and Its Application Scenarios

This article introduces message queue middleware, explains its role in distributed systems for asynchronous processing, system decoupling, traffic shaping, log handling and message communication, and provides concrete e‑commerce and log‑collection examples illustrating how queues improve performance, scalability and reliability.

Log ProcessingMessage QueueSystem Decoupling
0 likes · 8 min read
Introduction to Message Queue Middleware and Its Application Scenarios
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Jun 18, 2018 · Backend Development

Unlocking High-Performance MQ: Lessons from Alibaba, Tencent, and Ctrip

To support Meituan’s rapid growth, this article examines the design and evolution of several industry-leading message-queue solutions—including Alibaba’s Notify and RocketMQ, Tencent’s Tube and Hippo, and Ctrip’s Herms—highlighting their reliability, scalability, and decoupling features, and extracting key insights for building robust MQ systems.

Message QueueMiddlewareReliability
0 likes · 7 min read
Unlocking High-Performance MQ: Lessons from Alibaba, Tencent, and Ctrip
Java Captain
Java Captain
May 30, 2018 · Backend Development

Key Points for Revisiting Message Queue Middleware: Usage, Drawbacks, Selection, High Availability, Idempotency, Reliability, and Ordering

This article reviews essential concepts of message queue middleware, covering why to use it, its drawbacks, selection criteria, high‑availability designs, preventing duplicate consumption, ensuring reliable transmission, and maintaining message order, providing a concise study guide for developers and architects.

MQMessage QueueReliability
0 likes · 21 min read
Key Points for Revisiting Message Queue Middleware: Usage, Drawbacks, Selection, High Availability, Idempotency, Reliability, and Ordering
Java Captain
Java Captain
Apr 29, 2018 · Backend Development

RabbitMQ Hello World Tutorial Using the Java Client

This article introduces RabbitMQ as a message broker, explains producer‑consumer terminology, and provides a step‑by‑step Java "Hello World" example with full code, compilation, and execution instructions for both sender and receiver programs.

AMQPJavaMessage Queue
0 likes · 9 min read
RabbitMQ Hello World Tutorial Using the Java Client
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Apr 12, 2018 · Backend Development

How Xiaomi Built the Notify Async Messaging System to Scale Its E‑commerce Platform

This article details Xiaomi's evolution from a simple two‑server e‑commerce site to a sophisticated, decoupled architecture with the Notify asynchronous messaging system, explaining design decisions, message splitting, agent proxying, performance upgrades, and lessons for building resilient backend services.

Message QueueSystem Architectureasynchronous messaging
0 likes · 13 min read
How Xiaomi Built the Notify Async Messaging System to Scale Its E‑commerce Platform
Didi Tech
Didi Tech
Apr 11, 2018 · Backend Development

How to Turn Synchronous RPC into Asynchronous Queues for Reliable Microservices

The article examines the reliability challenges of microservice architectures that rely heavily on synchronous RPC calls, and proposes a comprehensive solution that converts failing RPCs to asynchronous message‑queue workflows, introduces a write‑ahead‑queue for transactional consistency between databases and queues, and outlines offset management to ensure end‑to‑end fault tolerance.

KafkaMessage QueueRPC
0 likes · 12 min read
How to Turn Synchronous RPC into Asynchronous Queues for Reliable Microservices
Programmer DD
Programmer DD
Apr 6, 2018 · Backend Development

How to Choose the Right Message Middleware: Kafka vs RabbitMQ Deep Dive

This comprehensive guide compares Kafka and RabbitMQ across functional features, performance, reliability, operational management, and ecosystem support, offering practical criteria and pitfalls to help engineers select the most suitable message middleware for their distributed systems.

Message QueueMiddleware SelectionReliability
0 likes · 30 min read
How to Choose the Right Message Middleware: Kafka vs RabbitMQ Deep Dive
Architecture Digest
Architecture Digest
Apr 3, 2018 · Backend Development

A Systematic Overview of Message Queue Technical Points

This article provides a comprehensive, high‑level guide to message queue concepts, covering architecture, performance, high availability, scalability, protocols, consumption models, reliability, message types, ecosystem integration, and management tools for modern distributed systems.

MQMessage Queue
0 likes · 10 min read
A Systematic Overview of Message Queue Technical Points
JD Tech
JD Tech
Apr 2, 2018 · Backend Development

Introduction to MQTT and JMQ’s MQTT Support Architecture

This article introduces the MQTT protocol, outlines its key characteristics, explains the challenges it poses for IoT messaging, and details how JMQ addresses these challenges through a layered proxy‑broker architecture, subscription management, quality‑of‑service handling, and real‑world JD deployment.

BrokerIoTJMQ
0 likes · 8 min read
Introduction to MQTT and JMQ’s MQTT Support Architecture
Youzan Coder
Youzan Coder
Mar 30, 2018 · Backend Development

How Extended NSQ Message Formats Enable Load Testing, Isolation, and Filtering

This article explains the design of an extended NSQ message format, illustrates its application in load‑testing, service isolation, and channel‑level filtering scenarios, describes the NSQ migration proxy tool and Spark/Flume connectors, and outlines future enhancements such as flow control and batch subscription.

Extended Message FormatMessage FilteringMessage Queue
0 likes · 13 min read
How Extended NSQ Message Formats Enable Load Testing, Isolation, and Filtering
Programmer DD
Programmer DD
Mar 12, 2018 · Backend Development

How to Choose the Right Message Queue: Practical Insights Beyond the Hype

This article shares a seasoned developer’s perspective on selecting a message‑queue middleware, outlining typical adoption stages, three key evaluation criteria—coder expertise, current and future requirements, and community/ecosystem health—and offering candid advice on avoiding common pitfalls.

KafkaMessage QueueRocketMQ
0 likes · 9 min read
How to Choose the Right Message Queue: Practical Insights Beyond the Hype
System Architect Go
System Architect Go
Feb 28, 2018 · Backend Development

RabbitMQ Tutorial: Basic Async/Await Usage and Work Queues

This article explains RabbitMQ's typical workflow, demonstrates basic message publishing and consumption with async/await in Node.js, introduces work queues with persistent messages and prefetch, and discusses key concepts such as default exchanges, queue durability, and acknowledgment modes.

AcknowledgmentAsync/AwaitMessage Queue
0 likes · 5 min read
RabbitMQ Tutorial: Basic Async/Await Usage and Work Queues
Programmer DD
Programmer DD
Feb 10, 2018 · Backend Development

How RocketMQ Handles Transactional Messages: From Producer to Broker

This article explains the internal workflow of RocketMQ transactional messages, covering how producers send half messages, how brokers process commit or rollback requests, the storage mechanisms for transaction state, the periodic transaction check logic, and the differences between file‑system and database implementations.

BrokerJavaMessage Queue
0 likes · 22 min read
How RocketMQ Handles Transactional Messages: From Producer to Broker
JD Retail Technology
JD Retail Technology
Feb 5, 2018 · Backend Development

Design and Implementation of Footprint Platform, Mock Server Platform, and Pre‑release Gray Release Solution for Virtual Products

This article presents the challenges of virtual product development and describes three engineering solutions—a Footprint tracking system, a Mock Server platform, and a pre‑release gray‑release strategy—detailing their backgrounds, architectures, implementations, and operational benefits for improving debugging, testing, and deployment efficiency.

Message QueueSystem DesignTracing
0 likes · 8 min read
Design and Implementation of Footprint Platform, Mock Server Platform, and Pre‑release Gray Release Solution for Virtual Products
Architect's Tech Stack
Architect's Tech Stack
Feb 3, 2018 · Backend Development

Quick Guide to Installing, Configuring, and Using Apache RocketMQ 4.2

This tutorial provides a step‑by‑step walkthrough for setting up Apache RocketMQ 4.2 on a 64‑bit Linux system, covering environment prerequisites, downloading source, building binaries, starting NameServer and Broker, sending and receiving messages, and shutting down the services.

BrokerInstallationJava
0 likes · 6 min read
Quick Guide to Installing, Configuring, and Using Apache RocketMQ 4.2
Alibaba Cloud Developer
Alibaba Cloud Developer
Jan 19, 2018 · Backend Development

Dynamic MQ Consumer Throttling with Alibaba Cloud ACM

This article explains how to implement various flow‑control strategies—static rate limiting, dynamic resource‑based limits, connection and concurrency controls—and demonstrates a practical, configuration‑center‑driven approach to globally throttle asynchronous MQ consumers using Alibaba Cloud ACM and Java.

Alibaba CloudConfiguration CenterFlow Control
0 likes · 8 min read
Dynamic MQ Consumer Throttling with Alibaba Cloud ACM
AI Cyberspace
AI Cyberspace
Dec 6, 2017 · Operations

Master RabbitMQ: Message Acknowledgment, Prefetch, RPC, vhosts & Plugins

This article explores RabbitMQ’s core features—including message acknowledgment, prefetch count, RPC support, virtual hosts, and its powerful plugin system—explaining how each works, when to enable or disable them, and providing step‑by‑step command‑line examples for configuring users, permissions, and management tools.

ConfigurationMessage Queueoperations
0 likes · 9 min read
Master RabbitMQ: Message Acknowledgment, Prefetch, RPC, vhosts & Plugins
AI Cyberspace
AI Cyberspace
Dec 4, 2017 · Backend Development

Master RabbitMQ: Install, Core Concepts, and How It Powers Distributed Systems

This article introduces RabbitMQ's role in distributed systems, explains the AMQP protocol, provides step‑by‑step Ubuntu installation commands, and details essential objects such as messages, producers, consumers, queues, exchanges, bindings, routing keys, and exchange types.

AMQPInstallationMessage Queue
0 likes · 8 min read
Master RabbitMQ: Install, Core Concepts, and How It Powers Distributed Systems
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Nov 20, 2017 · Backend Development

Synchronous vs Asynchronous Messaging: When to Use Queues and How They Impact Performance

This article explains the fundamental differences between synchronous and asynchronous communication, explores how message queues decouple producers and consumers, and discusses key considerations such as persistence, performance, reliability, and language support for building robust backend systems.

Message QueueReliabilitySynchronous
0 likes · 9 min read
Synchronous vs Asynchronous Messaging: When to Use Queues and How They Impact Performance
Architecture Digest
Architecture Digest
Sep 10, 2017 · Backend Development

Understanding Distributed Transaction Patterns: TCC, Asynchronous Assurance, and Maximum Effort Notification

The article explains common interview questions on distributed systems and compares transaction coordination methods, detailing the two‑phase commit drawbacks and introducing three patterns—TCC, asynchronous assurance, and maximum‑effort notification—along with their advantages, usage scenarios, and practical considerations.

Distributed TransactionsMessage QueueTCC
0 likes · 4 min read
Understanding Distributed Transaction Patterns: TCC, Asynchronous Assurance, and Maximum Effort Notification
Architecture Digest
Architecture Digest
Aug 30, 2017 · Backend Development

Evolution of System Architecture and Key Distributed Service Technologies

This article outlines the progressive stages of system architecture—from a single‑server LAMP setup through application‑data separation, caching, clustering, read/write splitting, CDN, distributed storage, NoSQL, business decomposition, and finally distributed services—while detailing essential technologies such as message queues, service frameworks, service buses, communication patterns, and governance mechanisms like Dubbo and OSB.

Message Queuebackend developmentdistributed systems
0 likes · 14 min read
Evolution of System Architecture and Key Distributed Service Technologies
21CTO
21CTO
Jul 23, 2017 · Backend Development

Comparing Kafka and RocketMQ: Architecture, Availability, and Reliability Insights

This article examines the architectures of Kafka and RocketMQ, analyzes their availability and reliability mechanisms, evaluates their strengths and weaknesses, and proposes a hybrid MQ design that combines the benefits of both systems while simplifying dependencies and improving fault tolerance.

KafkaMessage QueueRocketMQ
0 likes · 13 min read
Comparing Kafka and RocketMQ: Architecture, Availability, and Reliability Insights
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Jun 24, 2017 · Backend Development

Master RocketMQ on CentOS: Deployment, Client Code, and Best Practices

This guide walks through installing RocketMQ on a CentOS 6.5 VM, launching NameServer and Broker, provides sample Java consumer and producer code, and outlines best‑practice tips for idempotent consumption, batch processing, message filtering, performance tuning, and reliable message delivery.

Message QueueRocketMQbest practices
0 likes · 13 min read
Master RocketMQ on CentOS: Deployment, Client Code, and Best Practices
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Jun 23, 2017 · Backend Development

Unlocking RocketMQ: Core Features, Architecture, and Performance Secrets

RocketMQ is a distributed queue-based middleware offering strict message ordering, diverse pull modes, scalable subscribers, real-time subscription, and massive message accumulation, with detailed network deployment, storage mechanisms, key features, flushing strategies, query methods, server-side filtering, JVM memory utilization, and solutions for message backlog.

Message QueueRocketMQbackend development
0 likes · 14 min read
Unlocking RocketMQ: Core Features, Architecture, and Performance Secrets
ITPUB
ITPUB
May 19, 2017 · Backend Development

How Message Queues Turn Slow Email Sends into Fast, Reliable Services

This article tells the story of a developer who first used a blocking email call, then switched to multithreading, and finally adopted a message queue to achieve asynchronous processing, decoupling, scalability, and reliability for user registration emails.

Java MultithreadingMessage Queueasynchronous processing
0 likes · 6 min read
How Message Queues Turn Slow Email Sends into Fast, Reliable Services
WeChat Backend Team
WeChat Backend Team
May 7, 2017 · Backend Development

How WeChat’s MQ 2.0 Redefined Asynchronous Queues for Massive Scale

This article explains the design and improvements of WeChat's MQ 2.0 asynchronous queue, covering its cross‑machine consumption model, enhanced task scheduling, MapReduce‑style processing, stream tasks, and robust overload protection that together enable high‑performance, resilient backend services.

Message QueueTask Schedulingasynchronous processing
0 likes · 13 min read
How WeChat’s MQ 2.0 Redefined Asynchronous Queues for Massive Scale
Qunar Tech Salon
Qunar Tech Salon
May 5, 2017 · Backend Development

WeChat MQ 2.0: Enhanced Asynchronous Queue Design and Optimizations

The article introduces WeChat's self‑developed MQ 2.0 asynchronous queue, detailing its architecture, cross‑machine consumption model, improved task scheduling, efficient processing frameworks—including a MapReduce‑style engine and streaming tasks—and robust overload protection mechanisms that together boost reliability and performance for large‑scale backend services.

MapReduceMessage QueueStreaming Tasks
0 likes · 12 min read
WeChat MQ 2.0: Enhanced Asynchronous Queue Design and Optimizations
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Apr 21, 2017 · Backend Development

Mastering Producer‑Consumer and Pub/Sub with RabbitMQ: Real‑World Patterns Explained

This article explains the producer‑consumer and publish‑subscribe messaging patterns, introduces RabbitMQ’s core concepts such as exchanges, queues, routing keys, and reliability mechanisms, and demonstrates how to apply these patterns to data ingestion and event distribution scenarios with practical diagrams.

Message QueueMessaging PatternsPublish-Subscribe
0 likes · 9 min read
Mastering Producer‑Consumer and Pub/Sub with RabbitMQ: Real‑World Patterns Explained
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Apr 21, 2017 · Backend Development

Mastering Kafka: Producer‑Consumer vs Pub/Sub Patterns for Scalable Backend Design

This article explains Kafka's core concepts and compares producer‑consumer and publish‑subscribe models, illustrating how to apply each pattern for data ingestion and event distribution in distributed backend systems, and offers practical design alternatives when Kafka’s native capabilities fall short.

KafkaMessage QueuePublish-Subscribe
0 likes · 10 min read
Mastering Kafka: Producer‑Consumer vs Pub/Sub Patterns for Scalable Backend Design
Architecture Digest
Architecture Digest
Mar 3, 2017 · Operations

High-Concurrency Architecture: Strategies, Testing, and Practical Solutions

This article outlines the design and implementation of high‑concurrency systems, covering server architecture, load balancing, database clustering, caching strategies, message‑queue based asynchronous processing, static data handling, and operational best practices such as monitoring, redundancy, and automation.

Message QueueServer Architecturecaching
0 likes · 18 min read
High-Concurrency Architecture: Strategies, Testing, and Practical Solutions
dbaplus Community
dbaplus Community
Feb 13, 2017 · Backend Development

Why Message Queues Are Essential for Scalable Distributed Systems

Message queues act as a crucial middleware component in distributed systems, addressing coupling, asynchronous processing, traffic shaping, and high availability, with real-world scenarios such as asynchronous handling, decoupling, traffic throttling, logging, and communication, while reviewing popular solutions like ActiveMQ, RabbitMQ, ZeroMQ, Kafka, and JMS.

KafkaMessage QueueZeroMQ
0 likes · 20 min read
Why Message Queues Are Essential for Scalable Distributed Systems
Ctrip Technology
Ctrip Technology
Jan 25, 2017 · Backend Development

Handling Duplicate Messages, Ordering, Concurrency, and Batch Processing in Message‑Driven Systems

This article shares practical patterns and built‑in mechanisms for dealing with duplicate messages, message ordering, concurrent updates, asynchronous acknowledgments, and batch processing in a large‑scale, message‑driven architecture, illustrated with QMQ examples from Qunar's platform.

Batch ProcessingConcurrency ControlDuplicate Message Handling
0 likes · 16 min read
Handling Duplicate Messages, Ordering, Concurrency, and Batch Processing in Message‑Driven Systems
dbaplus Community
dbaplus Community
Dec 14, 2016 · Backend Development

Master Memcached, Redis, and RabbitMQ: Install, Configure, and Use with Python

This guide walks through the fundamentals, installation steps, configuration details, and Python integration for three essential backend services—Memcached for high‑performance caching, Redis for persistent key‑value storage, and RabbitMQ for reliable messaging—complete with command‑line examples, code snippets, and best‑practice tips.

MemcachedMessage QueuePython
0 likes · 19 min read
Master Memcached, Redis, and RabbitMQ: Install, Configure, and Use with Python
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Dec 2, 2016 · Backend Development

Mastering Distributed Transaction Consistency: From CAP to Message‑Based Compensation

This article examines the fundamental challenges of achieving consistency in distributed systems, explains the CAP theorem, compares two‑phase and three‑phase commit protocols, explores XA transactions, and presents practical compensation patterns such as local message tables, non‑transactional and transactional MQ designs, highlighting their trade‑offs and applicability.

CAP theoremEventual ConsistencyMessage Queue
0 likes · 15 min read
Mastering Distributed Transaction Consistency: From CAP to Message‑Based Compensation
High Availability Architecture
High Availability Architecture
Nov 25, 2016 · Backend Development

Disque: An Experimental Distributed In‑Memory Message Queue – Design and Usage Overview

Disque is an experimental, distributed, fault‑tolerant in‑memory message queue built in C that extends Redis concepts with synchronous replication, configurable delivery semantics, explicit acknowledgments, fast‑ack support, dead‑letter handling, and optional disk persistence for robust backend messaging workloads.

DisqueIn-MemoryMessage Queue
0 likes · 17 min read
Disque: An Experimental Distributed In‑Memory Message Queue – Design and Usage Overview
Architecture Digest
Architecture Digest
Nov 24, 2016 · Backend Development

High Concurrency Architecture and Practical Solutions for E‑commerce Applications

This article outlines the challenges of high‑traffic scenarios such as flash sales and timed red‑packet distribution, and presents a comprehensive backend architecture—including load balancing, database clustering, NoSQL caching, CDN, concurrency testing, message queues, first‑level caching, and static data strategies—to ensure smooth operation and optimal user experience.

Database ScalingMessage Queuebackend architecture
0 likes · 11 min read
High Concurrency Architecture and Practical Solutions for E‑commerce Applications
Architecture Digest
Architecture Digest
Nov 19, 2016 · Backend Development

Why Distributed Systems Are Essential for Scaling Internet Services and How to Build Them

The article explains that massive user traffic forces servers to adopt distributed systems to achieve high throughput, concurrency, low latency, and load balancing, and it details architectural patterns, concurrency models, caching, storage, coordination, messaging, transaction, deployment, and monitoring techniques for building and managing such systems.

Message Queuebackendcaching
0 likes · 39 min read
Why Distributed Systems Are Essential for Scaling Internet Services and How to Build Them
Architecture Digest
Architecture Digest
Nov 8, 2016 · Backend Development

Why Replace Distributed Transactions? A Message Queue and State‑Table Solution

The article explains the drawbacks of traditional two‑phase commit distributed transactions—reduced availability, performance, and scalability—and proposes a message‑queue‑plus‑state‑table pattern with idempotent processing to achieve eventual consistency while improving system throughput.

Distributed TransactionsMessage Queuebackend architecture
0 likes · 7 min read
Why Replace Distributed Transactions? A Message Queue and State‑Table Solution
dbaplus Community
dbaplus Community
Nov 1, 2016 · Information Security

Exploiting Message Queue Injection to Hijack Distributed Nodes with Celery

The article explains how insecure serialization in message‑queue middleware, especially Python's pickle used by Celery, can be abused to inject malicious payloads that trigger remote code execution on distributed workers, and it demonstrates detection and exploitation techniques against vulnerable Redis and MongoDB brokers.

Message QueuePythonRedis
0 likes · 17 min read
Exploiting Message Queue Injection to Hijack Distributed Nodes with Celery
ITPUB
ITPUB
Oct 22, 2016 · Backend Development

Designing Scalable High‑Concurrency Architecture: Practical Strategies and Patterns

This guide explains how to design and test high‑concurrency systems by choosing appropriate server architectures, load‑balancing, database clustering, caching layers, message queues, first‑level caches, and static data strategies to ensure smooth operation under heavy user traffic.

Message Queuebackend architecturecaching
0 likes · 12 min read
Designing Scalable High‑Concurrency Architecture: Practical Strategies and Patterns
dbaplus Community
dbaplus Community
Oct 19, 2016 · Backend Development

When to Use Kafka, RabbitMQ, or ZeroMQ: A Practical MQ Guide

This article explains the true purpose of message queues, classifies them into broker‑based and broker‑less families, compares Kafka, RabbitMQ, and ZeroMQ in terms of performance, flexibility, and lightweight distribution, and clarifies that MQs can support both asynchronous and synchronous communication.

KafkaMessage QueueZeroMQ
0 likes · 8 min read
When to Use Kafka, RabbitMQ, or ZeroMQ: A Practical MQ Guide
Architecture Digest
Architecture Digest
Aug 9, 2016 · Backend Development

Design and Evolution of Xiaomi's Notify Asynchronous Message System

This article details the three-stage evolution of Xiaomi's e‑commerce architecture, introduces the design of the Notify asynchronous message system built on Redis and MySQL, and explains the subsequent upgrades—including agent proxy, Go‑based modules, and MyCAT integration—to improve scalability, reliability, and performance.

GoMessage QueueSystem Architecture
0 likes · 13 min read
Design and Evolution of Xiaomi's Notify Asynchronous Message System
Architecture Digest
Architecture Digest
Jul 31, 2016 · Game Development

Designing Scalable Game Server Architecture: Pipelines, Gate, MQ, and Service‑Oriented Patterns

The article examines common misconceptions about game server performance, outlines essential message pipelines, introduces Gate as a reverse‑proxy for low‑latency scene synchronization, discusses integrating a message‑queue (MQ) for decoupled services, and presents a service‑oriented RPC framework with patterns to build maintainable, scalable multiplayer back‑ends.

GateMessage QueueNetworking
0 likes · 34 min read
Designing Scalable Game Server Architecture: Pipelines, Gate, MQ, and Service‑Oriented Patterns
Architecture Digest
Architecture Digest
Jul 14, 2016 · Backend Development

Design and Implementation of a Message/Notification System

This article outlines the concepts, classifications, and detailed backend design of a message/notification system, including architecture, database schemas, subscription mechanisms, push/pull strategies, and service-layer APIs for creating, pulling, and managing announcements, reminders, and messages.

Message QueueNotificationSystem Design
0 likes · 13 min read
Design and Implementation of a Message/Notification System
Architecture Digest
Architecture Digest
Jul 6, 2016 · Backend Development

Designing a Message Queue: Key Considerations and Architecture

The article explains why and when to use message queues, then walks through designing one from scratch, covering decoupling, eventual consistency, broadcast, flow control, RPC protocols, high availability, storage choices, consumer relationships, reliable delivery, transactions, performance optimizations, and push versus pull models.

AsynchronousMessage QueueRPC
0 likes · 35 min read
Designing a Message Queue: Key Considerations and Architecture
Meituan Technology Team
Meituan Technology Team
Jul 1, 2016 · Backend Development

Designing a Custom Message Queue: Principles and Practices

The article outlines how to design a custom message queue by first identifying appropriate use‑cases such as decoupling, eventual consistency, broadcasting and peak‑shaving, then examining push versus pull models, high‑availability, ordering, duplicate handling, storage choices, batch processing, flow‑control and performance optimizations, with advanced topics reserved for a follow‑up.

DesignMessage QueueReliability
0 likes · 34 min read
Designing a Custom Message Queue: Principles and Practices