Skip to content
Tagged articles

Message Queue

500 articles · Page 5 of 5
ITPUB
ITPUB
Jan 6, 2024 · Databases

Beyond Caching: How Redis Powers Distributed Locks, Queues, and More

This article explores Redis's capabilities beyond simple caching, detailing its use for distributed locks, rate limiting, session storage, complex business scenarios, and various messaging patterns—including List‑based queues, blocking commands, Pub/Sub, and the Stream data structure—while highlighting practical limitations and best‑practice recommendations.

Message QueueRedisStream
0 likes · 7 min read
Beyond Caching: How Redis Powers Distributed Locks, Queues, and More
Java High-Performance Architecture
Java High-Performance Architecture
Jan 3, 2024 · Backend Development

How to Prevent Message Loss in Kafka: Proven Strategies and Configurations

This article explains why introducing an MQ middleware helps with system decoupling and traffic control, outlines the data‑consistency challenges it creates, and provides practical methods to detect lost messages, identify loss points in producer, broker, and consumer stages, and configure Kafka to guarantee reliable delivery.

Message Queuedata consistencyreliability
0 likes · 15 min read
How to Prevent Message Loss in Kafka: Proven Strategies and Configurations
MaGe Linux Operations
MaGe Linux Operations
Dec 29, 2023 · Backend Development

How to Install and Run RocketMQ on CentOS 7: A Step‑by‑Step Guide

This article records a complete, step‑by‑step installation and startup process for Apache RocketMQ on a CentOS 7 system, covering environment checks, downloading the package, extracting files, launching the name server and broker, adjusting memory settings, and verifying the setup with a test client.

Message QueueRocketMQcentos7
0 likes · 4 min read
How to Install and Run RocketMQ on CentOS 7: A Step‑by‑Step Guide
LouZai
LouZai
Dec 7, 2023 · Backend Development

Designing a Scalable Comment System: Architecture, High Concurrency, and Moderation

This article walks through the full design of a large‑scale comment system, covering functional requirements, database schema, distributed architecture, high‑concurrency handling, caching, security measures like Bloom filters, and optional NLP‑based sentiment analysis to moderate live‑stream comments.

Bloom filterMessage QueueNLP
0 likes · 16 min read
Designing a Scalable Comment System: Architecture, High Concurrency, and Moderation
MaGe Linux Operations
MaGe Linux Operations
Dec 3, 2023 · Backend Development

Master RabbitMQ: Core Concepts, Programming Models, and Spring Boot Integration

This guide explains RabbitMQ fundamentals—including brokers, virtual hosts, connections, channels, exchanges, queues, producers, and consumers—covers common messaging patterns, provides step‑by‑step Java code for creating connections, declaring exchanges and queues, publishing and consuming messages, handling acknowledgments and confirmations, and shows how to integrate RabbitMQ with Spring Boot.

AMQPJavaMessage Queue
0 likes · 17 min read
Master RabbitMQ: Core Concepts, Programming Models, and Spring Boot Integration
Architect
Architect
Dec 2, 2023 · Backend Development

7 Common Message‑Queue Scenarios and How to Choose the Right Type

This article examines seven typical messaging scenarios—ordinary, ordered, delayed, transactional, trace, dead‑letter, and priority messages—explaining the problem each solves, the trade‑offs, and concrete implementations in RocketMQ, Pulsar, RabbitMQ and Kafka with code samples.

BackendMessage QueueTransaction
0 likes · 14 min read
7 Common Message‑Queue Scenarios and How to Choose the Right Type
JavaEdge
JavaEdge
Nov 24, 2023 · Backend Development

Why Kafka Is the Ultimate Backbone for Modern Backend Systems

This article explores how Kafka serves as a versatile backbone for messaging, durable storage, log aggregation, monitoring, commit logs, recommendation pipelines, stream processing, CDC, system migration, and event sourcing, highlighting its performance, reliability, and practical deployment patterns.

BackendData PipelineKafka
0 likes · 10 min read
Why Kafka Is the Ultimate Backbone for Modern Backend Systems
Zhuanzhuan Tech
Zhuanzhuan Tech
Nov 22, 2023 · Backend Development

Improving Stability and High Availability of an Advertising Billing System: Architecture Upgrade and Optimizations

This article describes the background, problems, and a series of architectural upgrades—including MQ replacement, thread‑pool isolation, Redis/TiKV redundancy, and Spark‑based compensation—to enhance the stability, scalability, and high‑availability of an advertising billing system.

AdvertisingBackendHigh Availability
0 likes · 12 min read
Improving Stability and High Availability of an Advertising Billing System: Architecture Upgrade and Optimizations
Java High-Performance Architecture
Java High-Performance Architecture
Nov 19, 2023 · Backend Development

Boost Java Performance with Disruptor: A Hands‑On Guide to High‑Throughput Queues

This article introduces the high‑performance Java library Disruptor, explains its core concepts such as Ring Buffer, Sequence, and Wait Strategy, and provides a step‑by‑step demo with Maven configuration, code examples, and test results to help developers implement fast, lock‑free producer‑consumer queues.

ConcurrencyDisruptorJava
0 likes · 12 min read
Boost Java Performance with Disruptor: A Hands‑On Guide to High‑Throughput Queues
Architect
Architect
Nov 16, 2023 · Backend Development

Understanding Transactional Messages in Distributed Systems: RocketMQ and Kafka

This article explains the principles of distributed transaction messages, comparing 2PC, TCC, and transactional messaging, and provides detailed walkthroughs of RocketMQ and Kafka implementations, including their two‑phase processes, broker handling, and source‑code insights for ensuring data consistency in asynchronous systems.

2PCDistributed SystemsMessage Queue
0 likes · 16 min read
Understanding Transactional Messages in Distributed Systems: RocketMQ and Kafka
Java High-Performance Architecture
Java High-Performance Architecture
Nov 15, 2023 · Backend Development

Mastering Disruptor: High‑Performance Java Queue for Producer‑Consumer Systems

This article introduces the open‑source Disruptor framework, explains its core concepts such as Ring Buffer, Sequencer, and Wait Strategies, and provides a step‑by‑step Java demo—including Maven setup, event factory, handlers, and a test case—to illustrate building a high‑throughput, low‑latency in‑memory message queue.

DisruptorJavaMessage Queue
0 likes · 11 min read
Mastering Disruptor: High‑Performance Java Queue for Producer‑Consumer Systems
MaGe Linux Operations
MaGe Linux Operations
Nov 12, 2023 · Backend Development

Why RocketMQ Producers Need Load Balancing and How It Works

This article explains why load balancing is crucial for RocketMQ producers, details the internal selection algorithm using ThreadLocal indexes and round‑robin logic, and provides Java code examples illustrating how messages are distributed across queues.

JavaMessage QueueRocketMQ
0 likes · 5 min read
Why RocketMQ Producers Need Load Balancing and How It Works
macrozheng
macrozheng
Nov 9, 2023 · Big Data

7 Real-World Kafka Use Cases Every Engineer Should Know

This article explains Kafka's core components and features, then details seven practical scenarios—including log processing, recommendation streams, monitoring, CDC, system migration, event sourcing, and message queuing—showing how Kafka powers modern distributed systems.

KafkaMessage Queuebig data
0 likes · 12 min read
7 Real-World Kafka Use Cases Every Engineer Should Know
ITPUB
ITPUB
Nov 7, 2023 · Big Data

7 Real-World Kafka Use Cases That Power Modern Distributed Systems

This article introduces Apache Kafka’s core components and key features, then details seven practical use cases—including log processing, recommendation streams, monitoring, CDC, system migration, event sourcing, and message queuing—illustrated with diagrams and step‑by‑step workflows for distributed systems.

KafkaMessage Queuebig data
0 likes · 10 min read
7 Real-World Kafka Use Cases That Power Modern Distributed Systems
Su San Talks Tech
Su San Talks Tech
Nov 3, 2023 · Backend Development

Mastering API Retry Strategies: 8 Proven Methods for Reliable Backend Calls

This article explores eight practical retry mechanisms for handling unreliable third‑party APIs in backend systems, covering simple loops, recursion, built‑in client retries, Spring Retry, Resilience4j, custom utilities, asynchronous thread‑pool retries, and message‑queue based approaches, plus best‑practice tips.

Message Queueasynchronous
0 likes · 18 min read
Mastering API Retry Strategies: 8 Proven Methods for Reliable Backend Calls
dbaplus Community
dbaplus Community
Nov 2, 2023 · Databases

Scaling a Ride‑Hailing Order System: From Single SQLServer to Sharded MySQL

This article recounts the step‑by‑step evolution of a ride‑hailing order service’s data layer—from a single SQLServer database through SQL optimization, read‑write splitting, business‑domain sharding, caching and MQ integration, to a custom sharding component and smooth migration to MySQL—highlighting challenges, solutions, and lessons learned.

Message QueueMySQLcaching
0 likes · 15 min read
Scaling a Ride‑Hailing Order System: From Single SQLServer to Sharded MySQL
LouZai
LouZai
Nov 1, 2023 · Databases

Beyond Caching: Real‑World Redis Use Cases and Scenarios

The article explains how Redis’s rich data structures and persistence options enable it to serve not only as a distributed cache but also as a primary store for user profiles, counters, leaderboards, relationships, active‑user tracking, distributed locks, rate limiting, messaging, geospatial queries, and more, while also discussing high‑availability and hot‑cold data challenges.

Data StructuresGeospatialMessage Queue
0 likes · 19 min read
Beyond Caching: Real‑World Redis Use Cases and Scenarios
JD Cloud Developers
JD Cloud Developers
Oct 25, 2023 · Backend Development

Master Kafka: Core Concepts, Architecture, and Practical Tips

This article explains Kafka's fundamentals, including topics, partitions, brokers, replication, producer‑consumer workflow, consumer groups, offset management, and common exception handling, while providing code examples and diagrams to help developers understand and effectively use this distributed messaging system.

Distributed SystemsJavaKafka
0 likes · 21 min read
Master Kafka: Core Concepts, Architecture, and Practical Tips
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Oct 19, 2023 · Backend Development

Understanding RocketMQ Core Architecture and Its Role in High‑Concurrency Systems

This article explains the core components of RocketMQ—including NameServer, Broker, Producer, and Consumer—detailing their functions, deployment diagrams, and how the middleware supports high‑concurrency scenarios such as peak shaving, asynchronous messaging, fault tolerance, and system decoupling.

Backend ArchitectureDistributed SystemsMessage Queue
0 likes · 7 min read
Understanding RocketMQ Core Architecture and Its Role in High‑Concurrency Systems
Architecture & Thinking
Architecture & Thinking
Oct 17, 2023 · Backend Development

Boost Throughput with RocketMQ Batch Messaging: How and Why

This article explains why batch messaging in RocketMQ is crucial for high-throughput systems, outlines its characteristics and ideal scenarios, and provides complete Java code examples for sending and splitting large batches to improve performance and reduce downstream API calls.

Batch MessagingJavaMessage Queue
0 likes · 7 min read
Boost Throughput with RocketMQ Batch Messaging: How and Why
Architect
Architect
Oct 13, 2023 · Backend Development

How to Implement Gray Release with RocketMQ: Step‑by‑Step Strategies

This article explains how to apply gray release techniques in RocketMQ by upgrading consumers, upgrading producers, and using consumer‑side filtering, tag filtering, and SQL92 filtering, providing concrete code examples, configuration steps, and trade‑off analysis for each approach.

Consumer FilteringGray ReleaseJava
0 likes · 8 min read
How to Implement Gray Release with RocketMQ: Step‑by‑Step Strategies
Wukong Talks Architecture
Wukong Talks Architecture
Oct 13, 2023 · Backend Development

7 Common Message Queue Scenarios and Their Implementations

This article explains seven typical message‑queue use cases—including ordinary, ordered, delayed, transactional, trace, dead‑letter, and priority messages—detailing their business motivations, implementation challenges, and concrete code examples for Kafka, RocketMQ, Pulsar, and RabbitMQ.

Distributed SystemsKafkaMessage Queue
0 likes · 11 min read
7 Common Message Queue Scenarios and Their Implementations
Top Architect
Top Architect
Oct 11, 2023 · Backend Development

Netty TCP Client Demo with Spring Boot: Architecture, Implementation, and Testing

This article presents a complete Netty TCP client demo built with Spring Boot, detailing the project architecture, module layout, business flow, key code implementations—including a local BlockingQueue, message processing with Redis locks, client initialization, handler logic, and testing endpoints—providing a practical reference for backend developers.

JavaMessage QueueNetty
0 likes · 21 min read
Netty TCP Client Demo with Spring Boot: Architecture, Implementation, and Testing
MaGe Linux Operations
MaGe Linux Operations
Oct 8, 2023 · Big Data

Understanding Kafka: Core Concepts, Architecture, and Performance Secrets

This article explains Kafka’s fundamental role as a message system, detailing topics, partitions, producers, consumers, replica management, consumer groups, the controller, Zookeeper coordination, and performance optimizations such as sequential writes, zero‑copy, log segmentation, and network design, providing a comprehensive overview for big‑data practitioners.

Consumer GroupDistributed SystemsKafka
0 likes · 11 min read
Understanding Kafka: Core Concepts, Architecture, and Performance Secrets
Senior Tony
Senior Tony
Oct 8, 2023 · Backend Development

When Architecture Becomes Overkill: Real‑World Lessons on Over‑Design

The article recounts a series of real‑world anecdotes exposing how excessive architectural ambitions—such as needless microservice fragmentation, ubiquitous message‑queue usage, multi‑level caching, over‑engineered design patterns, and configuration‑driven code—lead to wasted resources, maintenance headaches, and fragile systems, urging a return to simplicity.

Configuration ManagementMessage Queuecaching
0 likes · 12 min read
When Architecture Becomes Overkill: Real‑World Lessons on Over‑Design
Practical DevOps Architecture
Practical DevOps Architecture
Oct 8, 2023 · Backend Development

Comprehensive RocketMQ Course: Source Code Deep Dive, Advanced Features, Performance Tuning, and Real‑World Projects

This course provides an in‑depth study of RocketMQ, covering its fundamentals, source‑code analysis, advanced features such as transactional and ordered messages, performance optimization, operational monitoring, and hands‑on projects that guide learners through installation, configuration, clustering, and integration with Spring Boot.

Distributed SystemsMessage QueuePerformance Optimization
0 likes · 4 min read
Comprehensive RocketMQ Course: Source Code Deep Dive, Advanced Features, Performance Tuning, and Real‑World Projects
Efficient Ops
Efficient Ops
Oct 7, 2023 · Big Data

Master Kafka Basics: Topics, Partitions, Producers, and Cluster Architecture

This article explains Kafka's role as a messaging system, covering core concepts such as topics, partitions, producers, consumers, messages, cluster architecture, replicas, consumer groups, controller coordination with Zookeeper, and performance optimizations like sequential writes and zero‑copy networking.

Consumer GroupDistributed SystemsKafka
0 likes · 11 min read
Master Kafka Basics: Topics, Partitions, Producers, and Cluster Architecture
Architect
Architect
Oct 6, 2023 · Backend Development

Design and Implementation of QQ Reminder Subscription Push System

This article details the architecture, technical requirements, and implementation techniques—including hybrid push‑pull, heterogeneous storage, distributed scheduling, task chunking, and at‑least‑once delivery—used to build a high‑concurrency, reliable reminder notification service for QQ.

Distributed SchedulingMessage QueueMySQL
0 likes · 13 min read
Design and Implementation of QQ Reminder Subscription Push System
Spring Full-Stack Practical Cases
Spring Full-Stack Practical Cases
Sep 30, 2023 · Backend Development

Mastering RabbitMQ Delayed and Priority Queues with Spring Boot

This guide explains how to implement delayed and priority queues in RabbitMQ 3.8 using Spring Boot 2.6, covering dead‑letter exchange configuration, message expiration, priority settings, code examples for sending and consuming messages, and practical considerations such as priority limits and ordering behavior.

JavaMessage QueueRabbitMQ
0 likes · 8 min read
Mastering RabbitMQ Delayed and Priority Queues with Spring Boot
macrozheng
macrozheng
Sep 28, 2023 · Backend Development

Master RabbitMQ Integration in SpringBoot: From Theory to Real-World Code

This tutorial walks through RabbitMQ fundamentals, installation on macOS, core AMQP concepts, common exchange types, and step‑by‑step SpringBoot integration with code samples, while highlighting practical issues like connection leaks and the need for a connection pool.

JavaMessage QueueRabbitMQ
0 likes · 18 min read
Master RabbitMQ Integration in SpringBoot: From Theory to Real-World Code
Top Architect
Top Architect
Sep 25, 2023 · Backend Development

RabbitMQ vs Kafka: Detailed Comparison and When to Use Each

This article provides an in‑depth technical comparison of RabbitMQ and Apache Kafka, covering their core architectural differences, message ordering, routing, timing, retention, fault handling, scalability, consumer complexity, and offers guidance on selecting the appropriate platform for various backend scenarios.

KafkaMessage QueueRabbitMQ
0 likes · 18 min read
RabbitMQ vs Kafka: Detailed Comparison and When to Use Each
Wukong Talks Architecture
Wukong Talks Architecture
Sep 21, 2023 · Backend Development

Detecting and Preventing Message Loss in Kafka Message Queues

This article explains how to detect, diagnose, and prevent message loss in Kafka-based message queue systems by covering system decoupling, traffic control, data consistency challenges, producer, broker, and consumer issues, and offering configuration, monitoring, and operational best‑practice solutions.

Distributed SystemsKafkaMessage Queue
0 likes · 12 min read
Detecting and Preventing Message Loss in Kafka Message Queues
ShiZhen AI
ShiZhen AI
Sep 19, 2023 · Backend Development

How RocketMQ Handles Concurrent and Ordered Message Consumption

This article explains RocketMQ's internal workflow for concurrent and ordered message consumption, covering thread‑pool configuration, pull‑message handling, request submission, execution steps, offset management, expired‑message cleanup, and answers common questions about batch retries and offset ordering.

Concurrent ConsumptionConsumeRequestMessage Queue
0 likes · 13 min read
How RocketMQ Handles Concurrent and Ordered Message Consumption
Sohu Tech Products
Sohu Tech Products
Sep 13, 2023 · Backend Development

Unlocking Redis Streams: How Radix Tree & Listpack Power Modern MQs

This article explains why using Redis List for a message queue is limited, introduces Redis Stream as a purpose‑built MQ with consumer groups, ACKs, and persistence, and dives into its internal Radix‑Tree and listpack structures, command usage, and memory‑saving techniques.

BackendListpackMessage Queue
0 likes · 14 min read
Unlocking Redis Streams: How Radix Tree & Listpack Power Modern MQs
360 Smart Cloud
360 Smart Cloud
Sep 13, 2023 · Backend Development

Introduction to Apache Pulsar Architecture and Features

This article introduces Apache Pulsar, an open‑source cloud‑native distributed messaging platform, detailing its storage‑compute separation architecture, multi‑tenant support, load balancing, fault tolerance, schema handling, functions, IO connectors, tiered storage, cross‑region replication, and operational commands for managing brokers, bookies, and namespaces.

Apache PulsarDistributed SystemsMessage Queue
0 likes · 20 min read
Introduction to Apache Pulsar Architecture and Features
Senior Tony
Senior Tony
Sep 12, 2023 · Backend Development

What Really Powers High‑Concurrency Systems? Practical Solutions Explained

This article breaks down real‑world high‑concurrency strategies—horizontal scaling, caching, Elasticsearch, sharding, message‑queue smoothing, and cellization—explaining when each applies, their trade‑offs, and practical tips for building scalable, reliable backend services.

BackendMessage QueueScaling
0 likes · 9 min read
What Really Powers High‑Concurrency Systems? Practical Solutions Explained
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Sep 7, 2023 · Backend Development

Comprehensive Overview of Message Queues: Types, Core Concepts, and Comparison of Kafka, RocketMQ, and RabbitMQ

This article provides a detailed overview of popular message queue systems, explains their core concepts such as decoupling and eventual consistency, and compares the advantages and disadvantages of Kafka, RocketMQ, RabbitMQ, and other notable MQ solutions for high‑concurrency scenarios.

Backend ArchitectureDistributed SystemsKafka
0 likes · 7 min read
Comprehensive Overview of Message Queues: Types, Core Concepts, and Comparison of Kafka, RocketMQ, and RabbitMQ
MaGe Linux Operations
MaGe Linux Operations
Sep 4, 2023 · Databases

Why Redis Is So Fast: Features, Data Structures, and Real-World Use Cases

Redis is a high-performance, open-source in-memory key-value database offering rich data structures, persistence options, and advanced features like replication, clustering, and pub/sub, making it ideal for caching, counters, message queues, leaderboards, and session storage in demanding, high-concurrency applications.

Data StructuresMessage QueueRedis
0 likes · 9 min read
Why Redis Is So Fast: Features, Data Structures, and Real-World Use Cases
JD Tech
JD Tech
Aug 28, 2023 · Backend Development

Handling Large Payload Issues in JD Logistics: Causes, Impacts, and Mitigation Strategies

The article analyzes the root causes and system‑wide consequences of oversized messages in JD Logistics, explains middleware limits of JMQ and JSF, and presents design principles, code‑level checks, and practical mitigation techniques such as pagination, claim‑check pattern, batch sizing, and monitoring to prevent service outages.

JMQJSFMessage Queue
0 likes · 32 min read
Handling Large Payload Issues in JD Logistics: Causes, Impacts, and Mitigation Strategies
ITPUB
ITPUB
Aug 26, 2023 · Operations

When to Choose Kafka Over RabbitMQ? A Detailed Comparison

This article compares Kafka and RabbitMQ across scalability, durability, latency, data flow, ordering, reliability, persistence, extensibility, and complexity, then outlines ideal use cases for each and offers practical guidance on selecting the right message queue for a project.

KafkaMessage QueueRabbitMQ
0 likes · 8 min read
When to Choose Kafka Over RabbitMQ? A Detailed Comparison
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Aug 17, 2023 · Backend Development

Comprehensive Introduction to Message Queues

This article provides a thorough overview of message queues, covering their definition, core components, types (point‑to‑point and publish/subscribe), key characteristics such as asynchrony, loose coupling, distribution and reliability, selection criteria among popular MQ products, and typical application scenarios in high‑concurrency systems.

Backend ArchitectureDistributed SystemsMessage Queue
0 likes · 9 min read
Comprehensive Introduction to Message Queues
FunTester
FunTester
Aug 10, 2023 · Backend Development

How QQ Music Scaled Its Comment System for Celebrity Live Events

This article details the architectural redesign of QQ Music's comment platform—migrating to MongoDB, introducing threaded comments, and employing caching and message‑queue decoupling—to handle massive read/write spikes during celebrity live‑drop events while maintaining high availability and performance.

Backend ArchitectureHigh AvailabilityMessage Queue
0 likes · 8 min read
How QQ Music Scaled Its Comment System for Celebrity Live Events
Tencent Cloud Developer
Tencent Cloud Developer
Aug 9, 2023 · Backend Development

Designing a High‑Availability Comment System for QQ Music: Architecture, Challenges, and Optimizations

QQ Music’s comment system was re‑engineered with a MongoDB backend, cache layer, asynchronous writes, split read/write services, priority queues and rate‑limiting, enabling it to endure celebrity‑driven traffic spikes, maintain data consistency, and deliver high‑availability, low‑latency user experiences.

Backend ArchitectureHigh AvailabilityMessage Queue
0 likes · 7 min read
Designing a High‑Availability Comment System for QQ Music: Architecture, Challenges, and Optimizations
Su San Talks Tech
Su San Talks Tech
Jul 26, 2023 · Operations

How to Quickly Sync Massive Third-Party Data with SFTP, Jobs, and Rate-Limiting

Learn a step‑by‑step strategy to synchronize millions of records from dozens of third‑party systems across all provinces, using SFTP for bulk transfers, standardized file formats, scheduled jobs, Redis‑based rate limiting, MQ‑driven ingestion, and data‑consistency checks, while addressing security and performance challenges.

Message QueueSFTPjob scheduling
0 likes · 12 min read
How to Quickly Sync Massive Third-Party Data with SFTP, Jobs, and Rate-Limiting
Su San Talks Tech
Su San Talks Tech
Jul 21, 2023 · Backend Development

Mastering RocketMQ Transaction Messages: Theory, Flow, and Real‑World Example

This article explains RocketMQ transaction messages by covering their use cases, underlying mechanisms, and a step‑by‑step implementation that demonstrates how to ensure eventual consistency between message production and local database transactions in distributed Java back‑end systems.

Distributed SystemsJavaMessage Queue
0 likes · 8 min read
Mastering RocketMQ Transaction Messages: Theory, Flow, and Real‑World Example
Sohu Tech Products
Sohu Tech Products
Jul 19, 2023 · Backend Development

Understanding RocketMQ Consumption Logic in Version 4.9.x

This article provides a comprehensive walkthrough of RocketMQ 4.9.x consumption architecture, covering the four core roles, publish‑subscribe model, storage structures, load‑balancing, long‑polling, concurrent and ordered consumption flows, progress persistence, and retry mechanisms, with illustrative diagrams and code snippets.

ConsumerDistributed SystemsLong Polling
0 likes · 28 min read
Understanding RocketMQ Consumption Logic in Version 4.9.x
21CTO
21CTO
Jul 15, 2023 · Backend Development

From ActiveMQ to Pulsar: The Evolution of Message Queues Explained

This article traces the development of message queues from early decoupling solutions like ActiveMQ and RabbitMQ, through high‑throughput designs such as Kafka and RocketMQ, to modern platform‑centric systems like Pulsar, while detailing core concepts, architecture diagrams, storage mechanisms and trade‑offs.

BackendKafkaMessage Queue
0 likes · 15 min read
From ActiveMQ to Pulsar: The Evolution of Message Queues Explained
macrozheng
macrozheng
Jul 4, 2023 · Backend Development

Ensuring Cache‑DB Consistency with Canal, RabbitMQ, and Redis in SpringBoot

This guide walks through building a SpringBoot architecture that updates MySQL first, deletes Redis cache asynchronously via Canal and RabbitMQ, resolves common Canal meta‑data mismatches, and configures manual RabbitMQ acknowledgments to guarantee reliable cache invalidation.

Cache ConsistencyCanalMessage Queue
0 likes · 12 min read
Ensuring Cache‑DB Consistency with Canal, RabbitMQ, and Redis in SpringBoot
政采云技术
政采云技术
Jun 29, 2023 · Backend Development

Understanding RocketMQ: Architecture, Modules, and Deployment Essentials

This article provides a comprehensive overview of RocketMQ, covering its origin, core concepts, component roles, cluster deployment architecture, workflow, feature details, persistence mechanisms, and cleanup policies, offering developers a solid foundation for using this high‑performance messaging middleware.

ApacheDistributed SystemsMessage Queue
0 likes · 18 min read
Understanding RocketMQ: Architecture, Modules, and Deployment Essentials
MaGe Linux Operations
MaGe Linux Operations
Jun 20, 2023 · Big Data

What Is Kafka? A Beginner’s Guide to Distributed Streaming and Messaging

Kafka is an open‑source, distributed streaming platform that uses a publish/subscribe message queue architecture to provide high‑throughput, fault‑tolerant real‑time data processing, featuring topics, partitions, replicas, consumer groups, and multiple APIs for producers, consumers, streams, connectors, and administration.

KafkaMessage Queuebig data
0 likes · 20 min read
What Is Kafka? A Beginner’s Guide to Distributed Streaming and Messaging
Sanyou's Java Diary
Sanyou's Java Diary
Jun 15, 2023 · Databases

Mastering Redis Pub/Sub: Channels, Patterns, and Real-World Use Cases

This article explains Redis Pub/Sub fundamentals, demonstrates channel‑based and pattern‑based subscription with command‑line examples, dives into the internal data structures that power them, and shows how to integrate Redis Pub/Sub in Spring Boot using Redisson for lightweight messaging.

Message QueueRedisdatabases
0 likes · 14 min read
Mastering Redis Pub/Sub: Channels, Patterns, and Real-World Use Cases
Sanyou's Java Diary
Sanyou's Java Diary
Jun 12, 2023 · Backend Development

Master RocketMQ 4.9.x Consumption: Architecture, Load Balancing, and Retry Strategies

This article walks through RocketMQ 4.9.x’s consumption architecture, explaining the roles of NameServer, Broker, Producer and Consumer, the publish‑subscribe model, storage structures, load‑balancing algorithms, long‑polling, concurrent and ordered consumption, progress persistence, and the built‑in retry mechanism.

ConsumerDistributed SystemsMessage Queue
0 likes · 28 min read
Master RocketMQ 4.9.x Consumption: Architecture, Load Balancing, and Retry Strategies
Architect's Guide
Architect's Guide
Jun 6, 2023 · Backend Development

Kafka Core Concepts, Architecture, Performance Tuning, and Cluster Capacity Planning

This article provides a comprehensive overview of Kafka, covering its core value for decoupling and asynchronous processing, fundamental concepts such as producers, consumers, topics, partitions and replication, high‑performance mechanisms like zero‑copy and OS cache, detailed resource evaluation for CPU, memory, disk and network, operational tools, consumer‑group rebalance strategies, LEO/HW offsets, controller management, and delayed‑task scheduling.

BackendCluster PlanningConsumer Group
0 likes · 29 min read
Kafka Core Concepts, Architecture, Performance Tuning, and Cluster Capacity Planning
Top Architect
Top Architect
Jun 5, 2023 · Big Data

Deep Dive into Kafka’s High Reliability and High Performance Mechanisms

This article comprehensively explores Kafka’s core concepts, architecture, and the techniques it employs—such as ack strategies, replica synchronization, high‑watermark, leader‑epoch, zero‑copy, batch sending, compression, and reactor‑based networking—to achieve both strong reliability and high throughput in distributed messaging systems.

Distributed SystemsKafkaMessage Queue
0 likes · 31 min read
Deep Dive into Kafka’s High Reliability and High Performance Mechanisms
php Courses
php Courses
May 18, 2023 · Backend Development

RabbitMQ Message Queue Course: Introduction, Installation, PHP Integration, and TP6 Practical Implementation

This course covers an introduction to message queues and their use cases, detailed RabbitMQ concepts and installation, various PHP RabbitMQ patterns including simple, worker, fanout, direct, and topic modes, as well as dead‑letter and delayed queues, culminating in a TP6 practical implementation.

BackendMessage QueueRabbitMQ
0 likes · 3 min read
RabbitMQ Message Queue Course: Introduction, Installation, PHP Integration, and TP6 Practical Implementation
php Courses
php Courses
May 18, 2023 · Backend Development

Implementing Message Queues with PHP and RabbitMQ

This article explains how to set up a PHP development environment, install RabbitMQ and its dependencies, and provides complete producer and consumer code examples to create a simple "Hello World" message queue using RabbitMQ's AMQP protocol.

AMQPBackendMessage Queue
0 likes · 7 min read
Implementing Message Queues with PHP and RabbitMQ
WeChat Backend Team
WeChat Backend Team
May 17, 2023 · Big Data

Boosting Real-Time Recommendations: Apache Pulsar Optimizations at WeChat

This article details how WeChat's Gemini‑2.0 big‑data platform leverages Apache Pulsar, outlining cloud‑native advantages, load‑balancing refinements, cache and SSD tuning, high‑availability safeguards, and cost‑saving strategies that together enable large‑scale, real‑time, deep‑learning recommendation workloads.

Apache PulsarCloud NativeMessage Queue
0 likes · 17 min read
Boosting Real-Time Recommendations: Apache Pulsar Optimizations at WeChat
Top Architect
Top Architect
May 15, 2023 · Backend Development

Comprehensive Guide to Kafka: Architecture, Performance Tuning, and Operational Practices

This article provides an in-depth overview of Kafka, covering its core value as a message queue, fundamental concepts, cluster architecture, producer and consumer configurations, scaling strategies, monitoring tools, and practical operational commands for building and maintaining high‑throughput, highly available streaming systems.

BackendCluster ScalingKafka
0 likes · 31 min read
Comprehensive Guide to Kafka: Architecture, Performance Tuning, and Operational Practices
Top Architect
Top Architect
May 6, 2023 · Backend Development

Netty TCP Client Demo with Spring Boot: Architecture, Message Queue, and Complete Code Walkthrough

An in‑depth tutorial demonstrates building a Netty‑based TCP client with Spring Boot, covering project architecture, module layout, message‑queue simulation, detailed Java code for client creation, connection handling, and testing endpoints, providing a complete, production‑ready demo for IoT socket communication.

BackendJavaMessage Queue
0 likes · 26 min read
Netty TCP Client Demo with Spring Boot: Architecture, Message Queue, and Complete Code Walkthrough
ITPUB
ITPUB
May 2, 2023 · Backend Development

Four Ways to Sync MySQL Data to Elasticsearch – Pros, Cons, and Tools

This article compares four common approaches for synchronizing MySQL data to Elasticsearch—synchronous dual write, asynchronous dual write via message queues, scheduled tasks, and binlog‑based data subscription—detailing their advantages, drawbacks, implementation steps, and tool choices such as Canal, Maxwell, and Python‑MySQL‑Replication.

CanalElasticsearchMessage Queue
0 likes · 6 min read
Four Ways to Sync MySQL Data to Elasticsearch – Pros, Cons, and Tools
Top Architect
Top Architect
Apr 30, 2023 · Backend Development

Kafka Core Concepts, Architecture, Performance, and Operational Practices

This article provides a comprehensive overview of Kafka, covering its core value as a message queue, fundamental concepts, cluster architecture, log storage mechanisms, zero‑copy data transfer, high‑throughput and high‑availability design, consumer group behavior, rebalance strategies, and practical operational commands for managing topics, partitions, and offsets.

BackendDistributed SystemsHigh Availability
0 likes · 31 min read
Kafka Core Concepts, Architecture, Performance, and Operational Practices
Architecture Digest
Architecture Digest
Apr 23, 2023 · Backend Development

Kafka Core Concepts, Architecture, Performance Optimizations, and Production Deployment Guide

This article provides a comprehensive technical overview of Kafka, covering its core message‑queue value, architecture components such as producers, consumers, topics, partitions and replication, high‑performance mechanisms like zero‑copy and OS cache, resource planning for disks, memory, CPU and network, operational tools and commands, consumer‑group management, rebalance strategies, and internal scheduling mechanisms such as the time‑wheel.

Backend ArchitectureDistributed SystemsKafka
0 likes · 30 min read
Kafka Core Concepts, Architecture, Performance Optimizations, and Production Deployment Guide
Big Data Technology Architecture
Big Data Technology Architecture
Apr 22, 2023 · Big Data

Deep Dive into Kafka’s High Reliability and High Performance Mechanisms

This article comprehensively explores Kafka’s core architecture, explaining how asynchronous decoupling and traffic shaping are achieved, detailing the roles of producers, brokers, consumers, and ZooKeeper, and analyzing the reliability and performance techniques such as ACK policies, replication, idempotent and transactional producers, page‑cache flushing, zero‑copy, compression, batching, and load‑balancing strategies.

Distributed SystemsMessage Queuereliability
0 likes · 31 min read
Deep Dive into Kafka’s High Reliability and High Performance Mechanisms
Wukong Talks Architecture
Wukong Talks Architecture
Apr 15, 2023 · Backend Development

Design and Implementation of RocketMQ Tiered Storage

The article explains how RocketMQ 5.1.0 introduces a tiered storage module that offloads messages to cheaper media, describes its design, architecture layers, quick‑start configuration, upload and read mechanisms, prefetch cache, fault recovery, current development plans, and remaining challenges.

Message QueueRocketMQtiered storage
0 likes · 13 min read
Design and Implementation of RocketMQ Tiered Storage
Tencent Cloud Middleware
Tencent Cloud Middleware
Apr 13, 2023 · Fundamentals

RocketMQ, Kafka, Pulsar: Core Concepts, Architecture & Transactional Messaging

This article provides a comprehensive overview of major message‑queue middleware—including RocketMQ, Kafka, Pulsar, and RabbitMQ—covering fundamental concepts such as tags, groups, offsets, architectural components, storage mechanisms, transaction workflows, rebalance strategies, and recent developments, while comparing their features and performance characteristics.

KafkaMessage QueuePulsar
0 likes · 19 min read
RocketMQ, Kafka, Pulsar: Core Concepts, Architecture & Transactional Messaging
Code Ape Tech Column
Code Ape Tech Column
Apr 11, 2023 · Backend Development

Comprehensive Comparison of Kafka, RabbitMQ, ZeroMQ, RocketMQ, and ActiveMQ

This article provides a detailed side‑by‑side comparison of five popular message‑queue systems—Kafka, RabbitMQ, ZeroMQ, RocketMQ, and ActiveMQ—covering documentation, programming languages, supported protocols, storage, transactions, load balancing, clustering, management UI, availability, duplication handling, throughput, subscription models, ordering, acknowledgments, replay, retry, concurrency, and includes promotional information from the author.

ActiveMQKafkaMessage Queue
0 likes · 24 min read
Comprehensive Comparison of Kafka, RabbitMQ, ZeroMQ, RocketMQ, and ActiveMQ
Selected Java Interview Questions
Selected Java Interview Questions
Apr 7, 2023 · Backend Development

Designing a High‑Concurrency Flash Sale (秒杀) System Architecture

This article explains the architecture of a flash‑sale system from seven dimensions, covering characteristics, overall design, peak‑limiting, security, page optimization, asynchronous processing, hotspot isolation, Nginx configuration, Redis clustering, message‑queue throttling, database design, and captcha mechanisms to handle massive concurrent requests.

Message Queueflash salerate limiting
0 likes · 11 min read
Designing a High‑Concurrency Flash Sale (秒杀) System Architecture
360 Quality & Efficiency
360 Quality & Efficiency
Apr 7, 2023 · Backend Development

RabbitMQ Introduction: Installation, Basic and Advanced Producer/Consumer Patterns, Exchanges, and Common Issues

This guide introduces RabbitMQ, explains how to install it with Docker, covers basic and advanced producer/consumer usage including acknowledgments, durability, QoS, bindings, and exchange types, and discusses a typical Python reconnection problem, providing a practical overview for backend developers.

DockerExchangeMessage Queue
0 likes · 5 min read
RabbitMQ Introduction: Installation, Basic and Advanced Producer/Consumer Patterns, Exchanges, and Common Issues
Sanyou's Java Diary
Sanyou's Java Diary
Apr 3, 2023 · Backend Development

How RocketMQ’s Storage Model Powers Fast Message Retrieval

This article breaks down RocketMQ’s storage architecture, explaining how its commitlog, consumequeue, and index files work together to ensure reliable persistence, quick offset-based lookups, and efficient message consumption in a publish‑subscribe model.

CommitLogConsumeQueueIndexFile
0 likes · 9 min read
How RocketMQ’s Storage Model Powers Fast Message Retrieval
Code Ape Tech Column
Code Ape Tech Column
Mar 30, 2023 · Backend Development

How to Ensure No Message Loss in MQ Systems – Interview Guide and Practical Solutions

This article explains the common interview question of guaranteeing 100% message reliability in MQ middleware such as Kafka or RabbitMQ, outlines the three lifecycle stages of a message, discusses detection mechanisms, id generation, idempotent consumption, and handling message backlog, providing concrete design patterns and practical examples.

Distributed SystemsIdempotencyInterview
0 likes · 12 min read
How to Ensure No Message Loss in MQ Systems – Interview Guide and Practical Solutions
Laravel Tech Community
Laravel Tech Community
Mar 22, 2023 · Backend Development

Designing a High-Concurrency Flash Sale System Architecture

This article explains the key characteristics of flash‑sale (秒杀) business and presents a comprehensive backend architecture—including Nginx, CDN, gateway, Redis, MQ, asynchronous processing, hotspot isolation, and database strategies—to handle massive simultaneous requests while ensuring performance, reliability, and security.

Message Queueflash salehigh concurrency
0 likes · 11 min read
Designing a High-Concurrency Flash Sale System Architecture
Su San Talks Tech
Su San Talks Tech
Mar 22, 2023 · Backend Development

Why Does RocketMQ Duplicate Message Consumption? Root Causes Explained

This article examines the various reasons why RocketMQ can deliver the same message to consumers multiple times, covering send‑retry mechanisms, consumer‑side exceptions, offset commit and persistence failures, master‑slave synchronization issues, rebalance events, and long‑processing cleanup, and offers guidance on designing idempotent solutions.

Message QueueRebalanceRocketMQ
0 likes · 15 min read
Why Does RocketMQ Duplicate Message Consumption? Root Causes Explained
JD Retail Technology
JD Retail Technology
Mar 2, 2023 · Databases

Evolution of JD VOP Message Warehouse: From V1.0 to V3.0+ with Database Sharding and Performance Optimization

This article details the architectural evolution of JD's VOP message warehouse, describing the challenges of massive data volumes, the transition from V1.0 to V3.0+ through database sharding, MongoDB adoption, traffic governance, stability improvements, and cost reduction strategies, while presenting performance metrics and future outlook.

Message QueueMongoDBPerformance Optimization
0 likes · 17 min read
Evolution of JD VOP Message Warehouse: From V1.0 to V3.0+ with Database Sharding and Performance Optimization
Sanyou's Java Diary
Sanyou's Java Diary
Feb 27, 2023 · Backend Development

11 Ways to Implement Delayed Tasks in Java – From DelayQueue to Redis and MQ

This article surveys eleven practical techniques for implementing delayed tasks in Java, covering JDK utilities like DelayQueue, Timer, and ScheduledThreadPoolExecutor, as well as message‑queue solutions such as RocketMQ, RabbitMQ, Redis key‑expiration, Redisson, Netty, Hutool, Quartz, and simple polling, with code demos and implementation principles.

Message QueueRedisScheduling
0 likes · 26 min read
11 Ways to Implement Delayed Tasks in Java – From DelayQueue to Redis and MQ
Su San Talks Tech
Su San Talks Tech
Feb 24, 2023 · Backend Development

Why We’re Dropping RabbitMQ for Kafka: A Complete Migration Blueprint

Facing chaotic usage, maintenance challenges, partition tolerance issues, and performance bottlenecks with RabbitMQ, our middleware team decided to fully migrate to Kafka, outlining reasons, comparative models, migration strategies, and verification steps to ensure a smooth, high‑availability, high‑performance transition.

BackendKafkaMessage Queue
0 likes · 13 min read
Why We’re Dropping RabbitMQ for Kafka: A Complete Migration Blueprint
Java High-Performance Architecture
Java High-Performance Architecture
Feb 22, 2023 · Backend Development

8 Powerful Ways to Implement Asynchronous Programming in Java

This article explores eight Java asynchronous programming techniques—from raw threads and Future to CompletableFuture, Spring @Async, event-driven approaches, message queues, Hutool ThreadUtil, and Guava ListenableFuture—detailing their concepts, advantages, limitations, and providing complete code examples for each.

CompletableFutureFutureJava
0 likes · 14 min read
8 Powerful Ways to Implement Asynchronous Programming in Java
MaGe Linux Operations
MaGe Linux Operations
Feb 18, 2023 · Backend Development

8 Powerful Ways to Implement Asynchronous Programming in Java

This article explains why asynchronous execution improves latency in common scenarios like sending SMS or emails, and presents eight Java techniques—including threads, Future, CompletableFuture, Spring @Async, ApplicationEvent, message queues, third‑party utilities, and Guava—to implement robust asynchronous programming.

Asynchronous ProgrammingCompletableFutureFuture
0 likes · 14 min read
8 Powerful Ways to Implement Asynchronous Programming in Java
Tencent Cloud Middleware
Tencent Cloud Middleware
Feb 15, 2023 · Cloud Native

Tencent Cloud’s Secrets to Scaling Apache Pulsar: Stability & Performance Hacks

This article details Tencent Cloud's year‑long production experience with Apache Pulsar, covering why Pulsar was chosen over Kafka, deep dives into Ack hole handling, TTL/Backlog/Retention strategies, zk‑node and ledger leaks, cache optimizations, and concrete code snippets that illustrate the stability and performance improvements.

Apache PulsarCloud NativeMessage Queue
0 likes · 18 min read
Tencent Cloud’s Secrets to Scaling Apache Pulsar: Stability & Performance Hacks
ITPUB
ITPUB
Feb 12, 2023 · Backend Development

Uncovering RocketMQ Sync Lag: Why Messages Reach the Broker but Not the Consumer

A detailed investigation reveals that RocketMQ can report successful writes to the broker while consumers see minutes‑long delays because the transient store pool and commit‑log forwarding mechanisms delay the transfer of messages from the broker’s memory to the consumer queue.

JavaLag DiagnosisMessage Queue
0 likes · 10 min read
Uncovering RocketMQ Sync Lag: Why Messages Reach the Broker but Not the Consumer