Skip to content
Tagged articles

Message Queue

500 articles · Page 4 of 5
Tencent Cloud Developer
Tencent Cloud Developer
Nov 19, 2024 · Backend Development

Ten Common Interface Performance Optimization Techniques

Ten practical techniques—early validation, batch queries, asynchronous processing, parallel execution, caching, connection pooling, response compression, message‑queue decoupling, security best practices, and reusable design patterns—collectively reduce latency, boost throughput, and improve scalability of high‑concurrency interfaces.

Asynchronous ProgrammingDesign PatternsGo
0 likes · 29 min read
Ten Common Interface Performance Optimization Techniques
Programmer1970
Programmer1970
Nov 18, 2024 · Backend Development

How to Resolve Message Backlog and Why Kafka Outperforms RocketMQ

The article outlines practical solutions for RocketMQ message backlog—including scaling consumers, optimizing logic, batch consumption, producer throttling, broker tuning, monitoring, and emergency plans—then explains why Kafka delivers higher performance through sendfile zero‑copy, simple log storage, efficient memory use, and batch sending, and finally compares the two systems on reliability, retry, transactions, filtering, ordering, and suitable use cases.

KafkaMessage QueueRocketMQ
0 likes · 8 min read
How to Resolve Message Backlog and Why Kafka Outperforms RocketMQ
Liangxu Linux
Liangxu Linux
Nov 16, 2024 · Backend Development

Step‑by‑Step Guide to Install and Run RabbitMQ on Linux

This tutorial walks you through installing Erlang, downloading the RabbitMQ server, starting it in detached mode, verifying its status, and troubleshooting common TCP‑listener errors on CentOS systems, providing all necessary commands and configuration details.

LinuxMessage QueueRabbitMQ
0 likes · 6 min read
Step‑by‑Step Guide to Install and Run RabbitMQ on Linux
Tencent Cloud Middleware
Tencent Cloud Middleware
Oct 30, 2024 · Backend Development

How Kafka Guarantees High Reliability and Performance – A Deep Technical Dive

This article thoroughly examines Apache Kafka’s architecture, covering its macro components, ack strategies, replication mechanisms, high‑watermark handling, leader election, and performance optimizations such as batch sending, compression, PageCache, zero‑copy, mmap and sendfile, while also explaining common pitfalls like data loss and log corruption.

Distributed SystemsKafkaMessage Queue
0 likes · 31 min read
How Kafka Guarantees High Reliability and Performance – A Deep Technical Dive
Top Architect
Top Architect
Oct 24, 2024 · Backend Development

tldb Distributed Lock: Usage Guide for Go and Java

This article introduces tldb's distributed lock mechanism, explains lock, trylock, and unlock methods, and provides step‑by‑step Go and Java client examples—including code snippets—for acquiring and releasing locks in a multi‑language environment.

GoJavaMessage Queue
0 likes · 10 min read
tldb Distributed Lock: Usage Guide for Go and Java
Xiaohongshu Tech REDtech
Xiaohongshu Tech REDtech
Oct 23, 2024 · Backend Development

Pulsar vs RocketMQ: Architecture, Cost Benefits, and Migration Strategy for Xiaohongshu Online Messaging

Xiaohongshu replaced its RocketMQ‑based online messaging platform with Apache Pulsar, achieving up to 48% total cost reduction, 43% higher CPU utilization, 30% resource savings, and a latency drop from 20.2 ms to 5.7 ms through cloud‑native, elastic scaling and a phased migration strategy.

Apache PulsarMessage QueueRocketMQ
0 likes · 12 min read
Pulsar vs RocketMQ: Architecture, Cost Benefits, and Migration Strategy for Xiaohongshu Online Messaging
Tencent Cloud Middleware
Tencent Cloud Middleware
Oct 22, 2024 · Operations

Scaling Apache Pulsar on Tencent Cloud: Multi‑Network Access, Cluster Migration & HA Tips

This article details Tencent Cloud engineers' technical solutions for large‑scale Apache Pulsar deployments, covering multi‑network access challenges, a routing‑addressing redesign, product deployment models, a four‑step cluster migration process with subscription‑progress compensation, and high‑availability best practices such as rack‑aware and cross‑AZ replica distribution.

Apache PulsarCluster MigrationHigh Availability
0 likes · 11 min read
Scaling Apache Pulsar on Tencent Cloud: Multi‑Network Access, Cluster Migration & HA Tips
Test Development Learning Exchange
Test Development Learning Exchange
Oct 20, 2024 · Backend Development

Python Examples of Distributed Task Queues, Message Brokers, RPC, and Serialization Libraries

This article provides practical Python code examples for various messaging and serialization tools—including Celery, RQ, Huey, ZeroMQ, kafka‑python, Pika, stomp.py, nats‑py, gRPC, Thrift, Protobuf, Avro, msgpack, and Flatbuffers—demonstrating how to set up producers, consumers, and services for asynchronous processing and data exchange.

Distributed TasksMessage QueuePython
0 likes · 19 min read
Python Examples of Distributed Task Queues, Message Brokers, RPC, and Serialization Libraries
Alibaba Cloud Native
Alibaba Cloud Native
Oct 19, 2024 · Cloud Native

How ApsaraMQ’s Serverless Architecture Powers AI with Event‑Driven Messaging

The talk outlines ApsaraMQ’s journey to a fully serverless, cloud‑native messaging platform, detailing its compute‑storage separation, stateless proxy functions, RDMA‑enhanced performance, elastic scaling mechanisms, and how its event‑driven architecture empowers real‑time AI applications through seamless data vectorization.

AI IntegrationMessage QueueRDMA
0 likes · 19 min read
How ApsaraMQ’s Serverless Architecture Powers AI with Event‑Driven Messaging
MaGe Linux Operations
MaGe Linux Operations
Oct 7, 2024 · Operations

Why Choose RocketMQ? Features, Comparisons, and Reliability Explained

This article provides a comprehensive overview of RocketMQ, covering its architecture, key features such as high reliability, low latency and high throughput, comparisons with Kafka, RabbitMQ and ActiveMQ, and detailed mechanisms that ensure message durability, performance, and ordered consumption.

Distributed SystemsMessage QueueRocketMQ
0 likes · 12 min read
Why Choose RocketMQ? Features, Comparisons, and Reliability Explained
Architect's Guide
Architect's Guide
Oct 7, 2024 · Backend Development

RabbitMQ Overview, Installation Guide, and Delayed Message Implementation

This article introduces RabbitMQ, explains its core features and messaging model, discusses why to use it for asynchronous, decoupled, and throttled processing, and provides step‑by‑step installation instructions for macOS, Windows, and CentOS along with Java code examples for configuring and using delayed messages via the rabbitmq_delayed_message_exchange plugin.

BackendDelayed MessageJava
0 likes · 11 min read
RabbitMQ Overview, Installation Guide, and Delayed Message Implementation
Open Source Linux
Open Source Linux
Sep 27, 2024 · Operations

How to Install and Configure RabbitMQ with Erlang on Linux

This guide walks you through installing Erlang, downloading and building RabbitMQ 3.0.4 from source on a Linux system, verifying the installations, starting the server in detached mode, checking its status, and troubleshooting common port‑conflict issues on CentOS 6.

LinuxMessage QueueRabbitMQ
0 likes · 6 min read
How to Install and Configure RabbitMQ with Erlang on Linux
Liangxu Linux
Liangxu Linux
Sep 25, 2024 · Operations

How to Install and Troubleshoot RabbitMQ on Linux (Erlang Required)

This guide walks you through installing Erlang, downloading and extracting RabbitMQ 3.0.4, starting the server in detached mode, verifying its status, and troubleshooting common port‑conflict errors on CentOS 6, with complete command‑line examples.

LinuxMessage QueueRabbitMQ
0 likes · 6 min read
How to Install and Troubleshoot RabbitMQ on Linux (Erlang Required)
IT Services Circle
IT Services Circle
Sep 24, 2024 · Backend Development

Ensuring Message Reliability in RocketMQ: Producer, Storage, and Consumer Guarantees

This article explains how RocketMQ guarantees message reliability across the production, storage, and consumption stages, covering synchronous, asynchronous, and transactional sending, disk persistence and replication strategies, consumption models (at-least-once, at-most-once, exactly-once), and handling consumer crashes without message loss.

Consumer CrashMessage QueueMessage Reliability
0 likes · 6 min read
Ensuring Message Reliability in RocketMQ: Producer, Storage, and Consumer Guarantees
Java Backend Full-Stack
Java Backend Full-Stack
Sep 21, 2024 · Backend Development

How a Full‑Stack Charging‑Station Project Can Boost Your Interview Portfolio

This article walks through a zero‑to‑one charging‑station system built with Spring Cloud microservices, Vue front‑end, and a suite of enterprise features such as distributed locks, idempotency, multi‑level caching, and custom starters, providing concrete design documents and module breakdowns to help candidates showcase real project experience in interviews.

Charging StationDesign PatternsIdempotency
0 likes · 9 min read
How a Full‑Stack Charging‑Station Project Can Boost Your Interview Portfolio
Top Architect
Top Architect
Sep 21, 2024 · Backend Development

Refactoring a Task System with Unified Message Format and Configurable Rules Using QLExpress

The article describes how a senior architect restructured a company's activity middle‑platform task system by standardizing message formats, introducing a rule engine (QLExpress) for configurable task completion conditions, and automating integration, while also interspersing promotional content for AI tools and community services.

BackendMessage QueueQLExpress
0 likes · 11 min read
Refactoring a Task System with Unified Message Format and Configurable Rules Using QLExpress
Sanyou's Java Diary
Sanyou's Java Diary
Sep 19, 2024 · Operations

Message Queue Showdown: Choosing Kafka, Pulsar, RabbitMQ, RocketMQ or NSQ

This comprehensive guide compares five popular message queue systems—Kafka, Pulsar, RabbitMQ, RocketMQ, and NSQ—covering their architectures, core concepts, selection criteria, feature differences such as ordering, latency, durability, scaling, and operational considerations, to help engineers select the most suitable solution for their use cases.

KafkaMessage QueueNSQ
0 likes · 46 min read
Message Queue Showdown: Choosing Kafka, Pulsar, RabbitMQ, RocketMQ or NSQ
Architect
Architect
Sep 18, 2024 · Backend Development

Refactoring a Task System with a Unified Message Format and Configurable Rules

This article explains how a legacy task system was redesigned by standardizing incoming messages, introducing a rule engine (QLExpress) for configurable completion conditions, and building a lightweight admin UI, reducing task‑integration time from a week to a few minutes.

BackendMessage QueueQLExpress
0 likes · 9 min read
Refactoring a Task System with a Unified Message Format and Configurable Rules
Code Ape Tech Column
Code Ape Tech Column
Sep 12, 2024 · Backend Development

Distributed WebSocket Messaging with Redis and Kafka in Spring

This article explains how to enable cross‑server WebSocket communication in a distributed Spring application by using a message queue such as Redis or Kafka, detailing two architectural approaches, concrete code examples, configuration files, and a sample client page.

BackendKafkaMessage Queue
0 likes · 17 min read
Distributed WebSocket Messaging with Redis and Kafka in Spring
Bilibili Tech
Bilibili Tech
Sep 10, 2024 · Backend Development

Design and Implementation of a Scalable Reward System for Bilibili Live Platform

The paper presents a scalable, message‑queue‑driven reward system for Bilibili Live that unifies diverse reward types and distribution scenarios through standardized APIs, layered fast/slow queues, idempotent processing, multi‑stage retries, and comprehensive monitoring to ensure low latency, no over‑issuance, and reliable delivery.

BilibiliHigh AvailabilityIdempotency
0 likes · 16 min read
Design and Implementation of a Scalable Reward System for Bilibili Live Platform
Architect
Architect
Sep 9, 2024 · Backend Development

Understanding Redisson DelayedQueue: Internal Mechanisms and Practical Usage

This article explains how Redisson's DelayedQueue works internally, covering its data structures, the basic workflow for sending and receiving delayed messages, the initialization process, and the scheduling logic that moves expired items from the delay queue to the target queue.

DelayedQueueDistributed SystemsJava
0 likes · 16 min read
Understanding Redisson DelayedQueue: Internal Mechanisms and Practical Usage
macrozheng
macrozheng
Sep 9, 2024 · Backend Development

Why Redis Streams Can Replace Kafka for Lightweight Messaging

Redis Streams offer a memory‑efficient, easy‑to‑use message queue that matches many Kafka features, making it a practical alternative for projects that cannot afford the overhead of deploying a full‑blown Kafka infrastructure.

Kafka AlternativeMessage Queuebackend development
0 likes · 7 min read
Why Redis Streams Can Replace Kafka for Lightweight Messaging
Java High-Performance Architecture
Java High-Performance Architecture
Sep 9, 2024 · Backend Development

Designing a Scalable WebSocket Messaging Service with Reliable RabbitMQ Integration

This article outlines a comprehensive backend design that abstracts WebSocket into a reusable communication service, details project structure, business processes, reliability mechanisms for RabbitMQ, message classification, API design, and a unified message format to enable plug‑and‑play real‑time messaging across various Java applications.

Backend ArchitectureJavaMessage Queue
0 likes · 9 min read
Designing a Scalable WebSocket Messaging Service with Reliable RabbitMQ Integration
21CTO
21CTO
Aug 28, 2024 · Backend Development

Why Message Queues Are Essential for Scalable Backend Systems

This article explains how message queues decouple and buffer tasks such as payment processing, inventory updates, and notifications in high‑traffic online stores, improving reliability, scalability, and fault tolerance through asynchronous communication.

Asynchronous ProcessingBackend ArchitectureKafka
0 likes · 6 min read
Why Message Queues Are Essential for Scalable Backend Systems
JavaEdge
JavaEdge
Aug 27, 2024 · Backend Development

How RocketMQ Transaction Messages Decouple Financial Services

This article explains how RocketMQ's transaction messaging can break tight coupling between heterogeneous systems in fund companies, outlines topic/tag classification, compares distributed‑transaction solutions, and details the end‑to‑end workflow and consumption guarantees for financial use cases.

Financial ServicesMessage QueueRocketMQ
0 likes · 13 min read
How RocketMQ Transaction Messages Decouple Financial Services
Lobster Programming
Lobster Programming
Aug 27, 2024 · Backend Development

Designing High-Concurrency Systems: Architecture, Caching & Scaling

This article explains how to build high‑concurrency systems by decomposing monoliths into micro‑services, employing caching and message queues, separating databases, using read‑write splitting, and applying business‑level traffic shaping to achieve performance and availability.

Message Queuecachingsystem architecture
0 likes · 7 min read
Designing High-Concurrency Systems: Architecture, Caching & Scaling
Architect
Architect
Aug 23, 2024 · Backend Development

Understanding RocketMQ: Basic Concepts, Ordered Messages, and Transactional Messages

This article explains RocketMQ's core components, including domain models, message transmission models, reliability mechanisms, the challenges of ordered messaging, practical usage scenarios, and the design and implementation of transactional messages in both open‑source and proprietary versions.

BackendDistributed SystemsMessage Queue
0 likes · 21 min read
Understanding RocketMQ: Basic Concepts, Ordered Messages, and Transactional Messages
Architect's Journey
Architect's Journey
Aug 19, 2024 · Backend Development

Flexible Multi-MQ Component Update: Switch Between RocketMQ, Redis, Kafka, and RabbitMQ

The article explains why adopting a message‑queue improves microservice decoupling and responsibility boundaries, then details the design of a pluggable Base‑MQ component—including @MQEventListener, MQEvent base class, configuration, and MQClient interface—followed by concrete implementations for RocketMQ, Kafka, Redis and RabbitMQ, an example event flow, and guidance for extending the framework.

JavaKafkaMessage Queue
0 likes · 27 min read
Flexible Multi-MQ Component Update: Switch Between RocketMQ, Redis, Kafka, and RabbitMQ
DaTaobao Tech
DaTaobao Tech
Aug 14, 2024 · Backend Development

Deep Dive into RocketMQ Architecture and Core Components

The article thoroughly explains RocketMQ’s architecture—including stateless NameServers for routing, master‑slave Brokers with sequential CommitLog storage, stateless Producers and pull‑or‑push Consumers, message flow, indexing, and synchronous double‑write reliability—showing how these components deliver high‑throughput, scalable, fault‑tolerant messaging for distributed systems.

ConsumerDistributed SystemsMessage Queue
0 likes · 20 min read
Deep Dive into RocketMQ Architecture and Core Components
DaTaobao Tech
DaTaobao Tech
Aug 9, 2024 · Cloud Native

Deep Dive into RocketMQ: Storage Architecture and Consumer Processing Flow

RocketMQ stores messages in a sequential CommitLog while using a ConsumerQueue index for fast random access, and employs two looping threads—RebalanceService for load‑balancing queue assignments and PullMessageService for continuously pulling messages and dispatching them to user callbacks via a thread‑pooled consumer pipeline.

ConsumerDistributed SystemsJava
0 likes · 12 min read
Deep Dive into RocketMQ: Storage Architecture and Consumer Processing Flow
Java Tech Enthusiast
Java Tech Enthusiast
Aug 9, 2024 · Backend Development

RabbitMQ Overview, Installation Guide, and Delayed Message Implementation

RabbitMQ is a lightweight, open‑source AMQP broker offering reliable, flexible routing, clustering, and multi‑protocol support; it can be installed via Homebrew, Windows installers, or source on CentOS, and, using the rabbitmq_delayed_message_exchange plugin, Spring Boot applications can configure custom exchanges, queues, and send delayed messages with an x‑delay header.

Delayed MessagingJavaMessage Queue
0 likes · 9 min read
RabbitMQ Overview, Installation Guide, and Delayed Message Implementation
Architect
Architect
Aug 5, 2024 · Backend Development

How to Build a Scalable WebSocket Communication Service with Reliable Messaging

This article outlines the design of an internal WebSocket communication service that abstracts real‑time messaging, reduces code coupling, supports various business scenarios, ensures reliable delivery with RabbitMQ, defines unified APIs and message formats, and demonstrates a DDD‑based project structure for easy integration.

API designBackend ArchitectureDDD
0 likes · 10 min read
How to Build a Scalable WebSocket Communication Service with Reliable Messaging
Su San Talks Tech
Su San Talks Tech
Aug 5, 2024 · Fundamentals

Mastering Distributed Systems: Common Pitfalls and How to Avoid Them

This article explains the core concepts of distributed systems—including the CAP theorem, BASE theory, message‑queue challenges, Redis sentinel issues, sharding strategies, unique ID generation, and distributed transaction patterns—while offering practical guidance to prevent common pitfalls and improve reliability.

CAP theoremDistributed SystemsMessage Queue
0 likes · 27 min read
Mastering Distributed Systems: Common Pitfalls and How to Avoid Them
macrozheng
macrozheng
Aug 2, 2024 · Backend Development

How to Quickly Resolve Massive Kafka Message Backlog in Production

This guide explains why Kafka message backlogs occur, how to diagnose bugs, optimize consumer logic, and use temporary topics for emergency scaling, while emphasizing monitoring, alerts, and proper offset handling to keep your streaming system healthy.

ConsumerJavaKafka
0 likes · 5 min read
How to Quickly Resolve Massive Kafka Message Backlog in Production
Lobster Programming
Lobster Programming
Aug 2, 2024 · Backend Development

Ensuring Idempotent Consumption in MQ: Strategies and Code Examples

To prevent duplicate processing when integrating message queues for rate limiting and decoupling, this article explains idempotency concepts, common pitfalls, and five practical solutions—including query checks, pessimistic and optimistic locking, deduplication tables, and non‑transactional approaches—complete with code snippets and diagrams.

IdempotencyMessage Queuedatabase locking
0 likes · 11 min read
Ensuring Idempotent Consumption in MQ: Strategies and Code Examples
Zhuanzhuan Tech
Zhuanzhuan Tech
Jul 31, 2024 · Backend Development

HTTP Retry Strategies for Offline Store Systems: Simple Loop, Apache HttpClient, and Asynchronous MQ-Based Retries

This article examines the need for reliable HTTP retries in offline store applications, evaluates simple loop retries, explores Apache HttpClient's built‑in retry mechanism, and proposes a hybrid solution that combines customized HttpClient retry handling with asynchronous message‑queue retries to achieve high availability and eventual consistency.

Apache HttpClientHTTPJava
0 likes · 11 min read
HTTP Retry Strategies for Offline Store Systems: Simple Loop, Apache HttpClient, and Asynchronous MQ-Based Retries
Code Ape Tech Column
Code Ape Tech Column
Jul 30, 2024 · Backend Development

Design and Implementation of a Unified WebSocket Communication Service for Backend Systems

This article describes the background, objectives, core design, reliability mechanisms, message classification, API design, and unified calling approach of a company‑wide WebSocket abstraction layer that replaces polling, supports asynchronous communication, and ensures reliable message delivery using RabbitMQ and confirm mechanisms.

Backend ArchitectureMessage QueueRabbitMQ
0 likes · 10 min read
Design and Implementation of a Unified WebSocket Communication Service for Backend Systems
Shepherd Advanced Notes
Shepherd Advanced Notes
Jul 26, 2024 · Databases

How to Ensure MySQL‑Redis Data Synchronization Consistency (High‑Frequency Interview Question)

The article analyzes the challenges of keeping MySQL and Redis data consistent under high concurrency, compares four write‑order strategies, explains why they can cause stale cache data, and presents recommended solutions such as Cache‑Aside, distributed locks, message queues, and Canal‑based binlog syncing.

Cache AsideCanalDistributed Systems
0 likes · 11 min read
How to Ensure MySQL‑Redis Data Synchronization Consistency (High‑Frequency Interview Question)
Rare Earth Juejin Tech Community
Rare Earth Juejin Tech Community
Jul 22, 2024 · Big Data

Comprehensive Guide to Kafka: Architecture, Core Concepts, and Configuration

This article provides an in‑depth overview of Apache Kafka, covering its use cases, comparison with other message queues, versioning, performance mechanisms, core concepts such as topics, partitions, offsets, consumer groups, rebalancing, replication, leader election, idempotence, transactions, compression, interceptors, request handling, and practical configuration tips for reliable streaming applications.

ConsumerKafkaMessage Queue
0 likes · 25 min read
Comprehensive Guide to Kafka: Architecture, Core Concepts, and Configuration
Architect
Architect
Jul 12, 2024 · Backend Development

How to Prevent Message Loss and Duplication in Kafka and RocketMQ

This article analyzes the root causes of message loss and duplication in modern message queues, explains how synchronous and asynchronous sending affect reliability, compares storage strategies like sync‑flush and broker clustering, and offers concrete idempotent handling techniques using database constraints and Redis.

BackendKafkaMessage Queue
0 likes · 8 min read
How to Prevent Message Loss and Duplication in Kafka and RocketMQ
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Jul 3, 2024 · Backend Development

Preventing Duplicate Message Consumption in Kafka

This article explains why duplicate message consumption occurs in Kafka, outlines the underlying confirmation and consumer failure issues, and presents idempotent design strategies such as deduplication tables and code examples to ensure reliable processing.

KafkaMessage Queuebackend development
0 likes · 5 min read
Preventing Duplicate Message Consumption in Kafka
Java Tech Enthusiast
Java Tech Enthusiast
Jul 2, 2024 · Databases

Practical Redis Use Cases and Code Examples

This guide walks backend developers through twenty real‑world Redis use cases—from basic caching, lotteries, and like/collect features to ranking, PV/UV counting, Bloom filters, sign‑in, geo‑search, rate limiting, ID generation, distributed locks, messaging, session sharing, and more—providing Spring Boot code samples, limitations, and best‑practice advice.

Data StructuresDistributed SystemsMessage Queue
0 likes · 55 min read
Practical Redis Use Cases and Code Examples
Alibaba Cloud Developer
Alibaba Cloud Developer
Jul 2, 2024 · Backend Development

When Should You Send Messages in a Transaction? Real‑World Order Processing Insights

This article examines the trade‑offs of sending messages before, during, or after database persistence in order‑creation workflows, explores transaction‑message patterns, half‑message checks, and message‑table strategies, and offers practical guidance for building reliable backend messaging systems.

BackendMessage QueueTransaction
0 likes · 10 min read
When Should You Send Messages in a Transaction? Real‑World Order Processing Insights
Sanyou's Java Diary
Sanyou's Java Diary
Jul 1, 2024 · Backend Development

11 Ways to Implement Delayed Tasks in Java: From DelayQueue to Quartz

This article explores eleven practical methods for implementing delayed tasks in Java, covering native APIs like DelayQueue and Timer, advanced executors such as ScheduledThreadPoolExecutor, and popular messaging solutions including RocketMQ, RabbitMQ, Redis, Redisson, Netty, Hutool, and Quartz, with code demos and implementation details.

ConcurrencyMessage QueueRedis
0 likes · 27 min read
11 Ways to Implement Delayed Tasks in Java: From DelayQueue to Quartz
macrozheng
macrozheng
Jun 25, 2024 · Backend Development

7 Real-World Message Queue Patterns Every Backend Engineer Should Master

This article explores seven classic message‑queue use cases—from asynchronous decoupling and traffic‑shaping to delayed tasks, broadcast consumption, distributed transactions, and using Kafka as a data hub—illustrated with real‑world examples and code snippets.

Asynchronous ProcessingBroadcast ConsumptionDelayed Message
0 likes · 12 min read
7 Real-World Message Queue Patterns Every Backend Engineer Should Master
Wukong Talks Architecture
Wukong Talks Architecture
Jun 20, 2024 · Backend Development

Seven Classic Use Cases of Message Queues

This article shares seven practical scenarios—such as asynchronous processing, traffic smoothing, message bus, delayed tasks, broadcast consumption, distributed transactions, and data hub integration—where message queues like RocketMQ, Kafka, ActiveMQ, and RabbitMQ help solve high‑concurrency challenges in modern backend systems.

Asynchronous ProcessingBroadcast ConsumptionDelay Messages
0 likes · 11 min read
Seven Classic Use Cases of Message Queues
Open Source Linux
Open Source Linux
Jun 19, 2024 · Operations

How to Deploy a High‑Availability RabbitMQ Cluster on CentOS 7

This guide walks through preparing three CentOS 7 nodes, installing Erlang and RabbitMQ, configuring users and permissions, setting environment variables, enabling the management plugin, synchronizing erlang.cookie, joining nodes in RAM or disc mode, and verifying cluster status via the web UI.

CentOSClusterLinux
0 likes · 6 min read
How to Deploy a High‑Availability RabbitMQ Cluster on CentOS 7
AI Architecture Hub
AI Architecture Hub
Jun 17, 2024 · Backend Development

Master RabbitMQ: Core Concepts, Messaging Patterns, and Java Implementations

This article explains RabbitMQ’s architecture, details its core components, walks through the five main messaging patterns with visual diagrams, provides complete Java code examples for each pattern, and discusses reliability mechanisms such as acknowledgments, persistence, and practical use‑case scenarios.

JavaMessage QueueMessaging Patterns
0 likes · 22 min read
Master RabbitMQ: Core Concepts, Messaging Patterns, and Java Implementations
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Jun 6, 2024 · Backend Development

Comprehensive Introduction to RocketMQ: Architecture, Principles, and Use Cases

This article provides a detailed overview of RocketMQ, covering its core concepts, four primary usage scenarios, architectural components such as NameServer, Broker, Producer, and Consumer, as well as message storage, ordering guarantees, high availability, fault tolerance, and transactional messaging.

Distributed SystemsMessage QueueRocketMQ
0 likes · 6 min read
Comprehensive Introduction to RocketMQ: Architecture, Principles, and Use Cases
Sohu Tech Products
Sohu Tech Products
Jun 5, 2024 · Big Data

Why Kafka Is the Backbone of Modern Data Pipelines: Core Architecture and Use Cases

This article explains Kafka's role as a high‑throughput distributed message queue, detailing its core components, topic‑partition model, consumer groups, storage mechanisms, fault‑tolerance features, delivery guarantees, ZooKeeper coordination, and scalability strategies for building reliable real‑time data pipelines.

Distributed SystemsKafkaMessage Queue
0 likes · 14 min read
Why Kafka Is the Backbone of Modern Data Pipelines: Core Architecture and Use Cases
Top Architect
Top Architect
Jun 3, 2024 · Backend Development

Understanding Delay Queues and Implementing Them with JDK, RabbitMQ, Redis, and lmstfy

This article explains the concept, use cases, and common implementations of delay queues—including JDK's DelayQueue, RabbitMQ plugins, and Redis ZSet—followed by a detailed guide to installing, configuring, and using the open‑source lmstfy project, and concludes with promotional information for ChatGPT‑related services.

BackendGoMessage Queue
0 likes · 14 min read
Understanding Delay Queues and Implementing Them with JDK, RabbitMQ, Redis, and lmstfy
Beijing SF i-TECH City Technology Team
Beijing SF i-TECH City Technology Team
May 30, 2024 · Fundamentals

Understanding SFMQ: A Kafka Proxy Layer that Solves Common Message‑Queue Challenges

This article explains the practical problems encountered when using Kafka directly, introduces SFMQ—a Kafka‑based HTTP proxy that unifies client access, simplifies upgrades, provides delay and transaction capabilities via Redis, and demonstrates how its architecture resolves producer, consumer, and operational challenges.

Message QueueTransactional Messagingarchitecture
0 likes · 18 min read
Understanding SFMQ: A Kafka Proxy Layer that Solves Common Message‑Queue Challenges
Su San Talks Tech
Su San Talks Tech
May 18, 2024 · Databases

Boost Large Table Queries with Query Separation: When and How to Implement

This article explains query separation as a strategy to accelerate slow large‑table queries by duplicating data to a dedicated query store, outlines when to adopt it, compares synchronous, asynchronous, and binlog approaches, discusses storage choices such as MongoDB, HBase, Elasticsearch, and addresses consistency and MQ challenges.

ElasticsearchMessage QueueMongoDB
0 likes · 10 min read
Boost Large Table Queries with Query Separation: When and How to Implement
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
May 11, 2024 · Big Data

Comprehensive Introduction to Apache Kafka: Architecture, Features, and Use Cases

This article provides a detailed overview of Apache Kafka, covering its core characteristics, distributed architecture, key components such as topics, partitions, brokers, producers, consumers, ZooKeeper, and common application scenarios like log collection, event‑driven architecture, real‑time analytics, and monitoring.

Distributed SystemsKafkaMessage Queue
0 likes · 7 min read
Comprehensive Introduction to Apache Kafka: Architecture, Features, and Use Cases
Open Source Tech Hub
Open Source Tech Hub
May 6, 2024 · Backend Development

How to Build a Redis-Based Delayed Queue with Lua Scripts

This article explains the concept of delayed queues, compares them with scheduled tasks, outlines common business scenarios, and provides a complete Redis implementation using Sorted Sets, Lua scripts, and PHP code, including producer and consumer examples and performance considerations.

BackendMessage QueuePHP
0 likes · 17 min read
How to Build a Redis-Based Delayed Queue with Lua Scripts
Java Tech Enthusiast
Java Tech Enthusiast
Apr 30, 2024 · Backend Development

How to Prevent Message Loss and Duplication in Message Queues

This article examines why messages can be lost or duplicated in typical queue systems, explains the failure points from producer to broker to consumer, and provides practical techniques such as synchronous flushing, broker clustering, database unique constraints, and Redis deduplication to achieve reliable, idempotent processing.

BackendIdempotencyKafka
0 likes · 7 min read
How to Prevent Message Loss and Duplication in Message Queues
Su San Talks Tech
Su San Talks Tech
Apr 25, 2024 · Backend Development

Choosing the Right Message Queue: Kafka, RabbitMQ, RocketMQ, and ActiveMQ Compared

This article provides a comprehensive overview of four major message queue systems—Kafka, RabbitMQ, RocketMQ, and ActiveMQ—covering their fundamentals, architectures, key concepts, advantages, disadvantages, and guidance for selecting the most suitable solution based on throughput, reliability, scalability, and use‑case requirements.

BackendKafkaMessage Queue
0 likes · 18 min read
Choosing the Right Message Queue: Kafka, RabbitMQ, RocketMQ, and ActiveMQ Compared
Zhuanzhuan Tech
Zhuanzhuan Tech
Apr 24, 2024 · Backend Development

Understanding RocketMQ: Basics, Ordered Messages, and Transactional Messages

This article provides a comprehensive overview of Apache RocketMQ, covering its core concepts, message models, reliability mechanisms, ordered message challenges and solutions, as well as detailed explanations of transactional messages, including implementation principles, producer and broker workflows, and practical considerations for ensuring consistency in distributed systems.

Message QueueOrdered MessagesRocketMQ
0 likes · 24 min read
Understanding RocketMQ: Basics, Ordered Messages, and Transactional Messages
Wukong Talks Architecture
Wukong Talks Architecture
Apr 24, 2024 · Backend Development

Core Concepts and Common Patterns of RabbitMQ

This article explains why message queues are needed, outlines RabbitMQ's architecture, describes its basic concepts and working modes such as simple, work, fanout, direct and topic, and discusses reliability features like transactions, confirms, dead‑letter queues, TTL, clustering, ordering, and handling message backlogs.

Asynchronous ProcessingMessage QueueRabbitMQ
0 likes · 24 min read
Core Concepts and Common Patterns of RabbitMQ
Tongcheng Travel Technology Center
Tongcheng Travel Technology Center
Apr 17, 2024 · Backend Development

In-Depth Analysis of Apache RocketMQ Architecture, Operation Principles, and High‑Throughput Mechanisms

This article provides a comprehensive overview of Apache RocketMQ, detailing its core components, producer and consumer workflows, storage strategies, master‑slave synchronization, Raft‑based half‑write and leader election mechanisms, and best‑practice recommendations for high‑throughput, fault‑tolerant messaging systems.

Distributed SystemsFault ToleranceMessage Queue
0 likes · 22 min read
In-Depth Analysis of Apache RocketMQ Architecture, Operation Principles, and High‑Throughput Mechanisms
Java Architect Essentials
Java Architect Essentials
Apr 16, 2024 · Backend Development

Choosing the Right Delayed Task Solution: Redis Expiration, RabbitMQ Dead Letter, Time Wheel, and Redisson DelayQueue

The article evaluates common delayed‑task implementations—Redis expiration listeners, RabbitMQ dead‑letter queues, time wheels, and Redisson DelayQueue—explaining their drawbacks, proper use cases, and recommending reliable message‑queue solutions for e‑commerce order‑closing scenarios.

BackendMessage QueueRabbitMQ
0 likes · 7 min read
Choosing the Right Delayed Task Solution: Redis Expiration, RabbitMQ Dead Letter, Time Wheel, and Redisson DelayQueue
Alibaba Cloud Native
Alibaba Cloud Native
Apr 11, 2024 · Cloud Native

How RocketMQ 5.0 EventBridge Powers Cloud‑Native Event‑Driven Architecture

This article explores the evolution of message middleware, defines event‑driven architecture, explains why it resurfaces in the cloud era, and details RocketMQ 5.0 EventBridge’s design—its CloudEvents‑based abstraction, schema support, rule engine, observability, and real‑world use cases—offering practical guidance for building scalable, decoupled systems.

CloudEventsEventBridgeIoT
0 likes · 15 min read
How RocketMQ 5.0 EventBridge Powers Cloud‑Native Event‑Driven Architecture
Alibaba Cloud Native
Alibaba Cloud Native
Apr 7, 2024 · Cloud Native

How RocketMQ 5.0 Solves IoT Messaging Challenges with MQTT

This article explains the rapid growth of IoT, the unique messaging requirements it creates, compares classic and IoT message scenarios, and details how RocketMQ 5.0’s MQTT sub‑product introduces a lightweight protocol, read‑amplify storage, edge‑cloud integration, massive queue support, and a push‑pull delivery model to meet cloud‑native IoT demands.

IoTMQTTMessage Queue
0 likes · 13 min read
How RocketMQ 5.0 Solves IoT Messaging Challenges with MQTT
Architect
Architect
Mar 30, 2024 · Backend Development

11 Ways to Auto-Close Expired Orders: From Passive to Distributed Queues

The article systematically compares eleven technical approaches for automatically closing expired e‑commerce orders, detailing each method’s implementation steps, trade‑offs, performance characteristics, and ideal deployment scenarios, and finally ranks them to guide practical selection.

Backend ArchitectureDistributed SchedulingKafka
0 likes · 19 min read
11 Ways to Auto-Close Expired Orders: From Passive to Distributed Queues
Su San Talks Tech
Su San Talks Tech
Mar 30, 2024 · Backend Development

7 Real-World Message Queue Patterns Every Backend Engineer Should Know

From asynchronous decoupling to distributed transactions, this article explores seven classic message‑queue use cases—such as peak‑shaving, event buses, delayed tasks, broadcast consumption, and data hub integration—illustrated with real‑world examples from e‑commerce, ride‑hailing, and lottery systems, plus RocketMQ code snippets.

Asynchronous ProcessingDistributed SystemsKafka
0 likes · 13 min read
7 Real-World Message Queue Patterns Every Backend Engineer Should Know
vivo Internet Technology
vivo Internet Technology
Mar 27, 2024 · Backend Development

RocketMQ Multi-Version Environment Isolation Practice in Test Environments

The article details how vivo’s Internet Middleware Team migrated from RabbitMQ to RocketMQ and introduced a user‑property‑based multi‑version isolation layer that tags messages, filters them by consumer groups, and provides fallback and retry mechanisms, enabling test‑environment separation without SDK changes, though offline consumers may miss baseline messages.

Message QueueMulti-Version IsolationRocketMQ
0 likes · 12 min read
RocketMQ Multi-Version Environment Isolation Practice in Test Environments
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Mar 26, 2024 · Fundamentals

Mastering Message Queues: Core Concepts, Designs, and Popular MQs

Message Queues (MQ) are essential for scalable, decoupled systems, offering asynchronous communication, reliability, buffering, and high availability; this guide explains MQ fundamentals, characteristics, architectures like point-to-point and publish/subscribe, core components, design considerations, and reviews popular solutions such as RabbitMQ, Kafka, ActiveMQ, RocketMQ, and Pulsar.

Distributed SystemsMessage Queuearchitecture
0 likes · 9 min read
Mastering Message Queues: Core Concepts, Designs, and Popular MQs
Architecture Digest
Architecture Digest
Mar 13, 2024 · Backend Development

Using LMAX Disruptor as a High‑Performance In‑Memory Message Queue in Java

This article introduces the LMAX Disruptor library, explains its core concepts such as RingBuffer, Sequencer and WaitStrategy, and provides a step‑by‑step Java demo—including Maven dependency, model, event factory, handler, manager, service and test code—to build a fast, lock‑free producer‑consumer queue.

ConcurrencyDisruptorJava
0 likes · 10 min read
Using LMAX Disruptor as a High‑Performance In‑Memory Message Queue in Java
Sanyou's Java Diary
Sanyou's Java Diary
Mar 11, 2024 · Backend Development

Why RocketMQ Is So Fast: 10 Core Performance Techniques Explained

This article breaks down the ten key mechanisms—batch sending, message compression, Netty‑based networking, zero‑copy I/O, sequential writes, optimized storage structures, asynchronous flushing and replication, batch processing, lock refinements, and thread‑pool isolation—that together give RocketMQ its remarkable speed and efficiency.

Message QueueNettyRocketMQ
0 likes · 20 min read
Why RocketMQ Is So Fast: 10 Core Performance Techniques Explained
Architect's Guide
Architect's Guide
Mar 2, 2024 · Fundamentals

RabbitMQ vs Kafka: Core Differences and When to Use Each

This article compares RabbitMQ and Apache Kafka across architecture, message ordering, routing, timing, retention, fault handling, scalability, and consumer complexity, and provides guidance on which platform suits specific use‑cases such as flexible routing, strict ordering, long‑term retention, or high throughput.

Fault ToleranceKafkaMessage Queue
0 likes · 19 min read
RabbitMQ vs Kafka: Core Differences and When to Use Each
Code Ape Tech Column
Code Ape Tech Column
Feb 29, 2024 · Backend Development

Introduction to Disruptor: A High‑Performance Java Message Queue with Full Example

This article introduces the open‑source Disruptor library, explains its core concepts such as Ring Buffer, Sequence, Sequencer and Wait Strategy, and provides a step‑by‑step Java demo—including Maven dependency, event model, handlers, configuration, producer, and test code—to show how to build a fast in‑memory message queue.

ConcurrencyDisruptorJava
0 likes · 11 min read
Introduction to Disruptor: A High‑Performance Java Message Queue with Full Example
MaGe Linux Operations
MaGe Linux Operations
Feb 27, 2024 · Operations

How to Install and Deploy Apache RocketMQ 5.1.4 on Ubuntu

This guide walks you through setting up the Java environment, downloading Apache RocketMQ 5.1.4, installing its NameServer, Broker, and optional Proxy components on an Ubuntu 20.04 cloud instance, and configuring both local and cluster deployment modes with optional visual dashboard tools.

JavaMessage QueueRocketMQ
0 likes · 8 min read
How to Install and Deploy Apache RocketMQ 5.1.4 on Ubuntu
Volcano Engine Developer Services
Volcano Engine Developer Services
Feb 22, 2024 · Cloud Native

How BMQ’s Cloud‑Native Compute‑Storage Separation Revolutionizes Message Queues

This article explains how ByteDance’s BMQ, a cloud‑native message engine with a compute‑storage separated architecture, overcomes Kafka’s scalability and operational limits by using Proxy, Broker, Coordinator, and Controller modules, a distributed storage model, and advanced caching to achieve rapid scaling, high throughput, and resilient operations.

Cloud NativeMessage Queuedistributed storage
0 likes · 15 min read
How BMQ’s Cloud‑Native Compute‑Storage Separation Revolutionizes Message Queues
macrozheng
macrozheng
Feb 20, 2024 · Databases

10 Real-World Redis Use Cases Every Backend Engineer Should Know

Discover ten practical Redis scenarios—from counting page visits and caching category trees to implementing distributed locks, leaderboards, rate limiting, bitmap analytics, message queues, and global ID generation—each illustrated with concise code snippets and best‑practice tips for robust backend development.

BitmapLeaderboardMessage Queue
0 likes · 11 min read
10 Real-World Redis Use Cases Every Backend Engineer Should Know
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Feb 8, 2024 · Backend Development

Core Principles of Message Queues: 12 Key Concepts Explained

This article provides a comprehensive overview of message queue fundamentals, covering producers, consumers, brokers, point-to-point and publish/subscribe models, ordering, ACK mechanisms, eventual consistency, transactions, persistence, high availability, and selection criteria for various MQ technologies.

BackendDistributed SystemsMQ
0 likes · 10 min read
Core Principles of Message Queues: 12 Key Concepts Explained
MaGe Linux Operations
MaGe Linux Operations
Feb 7, 2024 · Backend Development

How to Deploy a High‑Availability RabbitMQ Cluster on Kubernetes with NFS Storage

This guide walks through installing RabbitMQ, explaining its features and typical use cases, then details step‑by‑step deployment of a mirrored‑mode RabbitMQ cluster on Kubernetes using StatefulSets, NFS‑backed persistent storage, RBAC, and verification of cluster health and management operations.

Cluster DeploymentKubernetesMessage Queue
0 likes · 23 min read
How to Deploy a High‑Availability RabbitMQ Cluster on Kubernetes with NFS Storage
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Feb 5, 2024 · Backend Development

Comprehensive Overview of RocketMQ: Architecture, Features, and Application Scenarios

This article provides an in‑depth introduction to RocketMQ, covering its evolution, core components, message domain model, key characteristics such as ordered delivery and deduplication, and typical use cases like traffic shaping, asynchronous decoupling, and distributed transaction messaging.

ApacheDistributed SystemsMessage Queue
0 likes · 8 min read
Comprehensive Overview of RocketMQ: Architecture, Features, and Application Scenarios
Sanyou's Java Diary
Sanyou's Java Diary
Feb 1, 2024 · Backend Development

Message Queues Unveiled: From Decoupling to Platformization and Core Architectures

This article traces the two‑decade evolution of message queues—from early decoupling solutions like ActiveMQ, through high‑throughput designs such as Kafka, to modern platformized systems like RocketMQ and Pulsar—while explaining fundamental concepts, partitioning, and storage architectures that underpin today’s distributed messaging platforms.

Distributed SystemsKafkaMessage Queue
0 likes · 17 min read
Message Queues Unveiled: From Decoupling to Platformization and Core Architectures
21CTO
21CTO
Jan 27, 2024 · Operations

How to Scale a System to Over 1 Million Users: From One Server to Multi‑Data‑Center Architecture

This article walks you through building a scalable system—from a single‑server prototype to a multi‑data‑center design that uses load balancers, database replication, caching, CDNs, stateless layers, message queues and automated monitoring—to handle traffic from hundreds of thousands to millions of users.

CDNDatabase ReplicationMessage Queue
0 likes · 26 min read
How to Scale a System to Over 1 Million Users: From One Server to Multi‑Data‑Center Architecture
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Jan 27, 2024 · Backend Development

Understanding Message Queues: Concepts, Use Cases, Types, and Common Implementations

This article introduces message queues, explaining their role in high‑traffic systems, key characteristics such as asynchronous communication, decoupling, reliability and buffering, compares point‑to‑point and publish‑subscribe models, and reviews popular implementations like RabbitMQ, Kafka, ActiveMQ, RocketMQ and Pulsar.

DecouplingKafkaMessage Queue
0 likes · 8 min read
Understanding Message Queues: Concepts, Use Cases, Types, and Common Implementations
IT Services Circle
IT Services Circle
Jan 25, 2024 · Operations

How to Resolve Online Message Queue Backlog Issues

This article explains why message queues can become backlogged, identifies producer and consumer causes, and provides practical strategies—including adding consumers, increasing queue capacity, optimizing consumption logic, implementing failure handling, and rapid remediation steps—to quickly resolve backlog in production environments.

Message Queuebacklogconsumer scaling
0 likes · 7 min read
How to Resolve Online Message Queue Backlog Issues
Programmer DD
Programmer DD
Jan 23, 2024 · Operations

How to Scale a System from Zero to One Million Users: Proven Strategies

This guide walks you through expanding a single‑server application into a highly available, horizontally‑scaled architecture that can serve over a million users by adding load balancers, database replication, caching layers, CDNs, stateless network design, multi‑data‑center support, message queues, monitoring and automation.

Database ReplicationMessage Queuecaching
0 likes · 26 min read
How to Scale a System from Zero to One Million Users: Proven Strategies
LouZai
LouZai
Jan 22, 2024 · Backend Development

8 Interface Retry Mechanisms – Which One Should You Choose?

This article compares eight ways to implement retry logic for remote API calls—including simple loops, recursion, Apache HttpClient settings, Spring Retry, Resilience4j, a custom utility, thread‑pool asynchronous retries, and message‑queue based retries—while outlining best‑practice guidelines such as idempotency, retry limits, and concurrency control.

ConcurrencyHTTP ClientJava
0 likes · 17 min read
8 Interface Retry Mechanisms – Which One Should You Choose?
MaGe Linux Operations
MaGe Linux Operations
Jan 21, 2024 · Big Data

Master Kafka: Core Concepts, Metrics, and Troubleshooting Guide

This article explains Kafka's fundamental components, version evolution, key monitoring metrics for producers, brokers, consumers and Zookeeper, and provides step‑by‑step troubleshooting methods for common issues such as slow topic throughput and message backlog.

KafkaMessage Queuebig data
0 likes · 8 min read
Master Kafka: Core Concepts, Metrics, and Troubleshooting Guide
Rare Earth Juejin Tech Community
Rare Earth Juejin Tech Community
Jan 13, 2024 · Big Data

What Is Kafka? Overview, Architecture, Features, Deployment, and Sample Code

Kafka, an Apache‑developed distributed publish/subscribe messaging system, provides reliable, high‑throughput real‑time data streaming with producers, consumers, brokers, streams, and connectors, and the article explains its core concepts, architecture, advantages, deployment methods, use cases, and includes Java code examples for producers and consumers.

JavaKafkaMessage Queue
0 likes · 8 min read
What Is Kafka? Overview, Architecture, Features, Deployment, and Sample Code