Tagged articles

Message Queue

1036 articles · Page 5 of 11
Su San Talks Tech
Su San Talks Tech
Jul 26, 2023 · Operations

How to Quickly Sync Massive Third-Party Data with SFTP, Jobs, and Rate-Limiting

Learn a step‑by‑step strategy to synchronize millions of records from dozens of third‑party systems across all provinces, using SFTP for bulk transfers, standardized file formats, scheduled jobs, Redis‑based rate limiting, MQ‑driven ingestion, and data‑consistency checks, while addressing security and performance challenges.

Job SchedulingMessage QueueSFTP
0 likes · 12 min read
How to Quickly Sync Massive Third-Party Data with SFTP, Jobs, and Rate-Limiting
Sohu Tech Products
Sohu Tech Products
Jul 19, 2023 · Backend Development

Understanding RocketMQ Consumption Logic in Version 4.9.x

This article provides a comprehensive walkthrough of RocketMQ 4.9.x consumption architecture, covering the four core roles, publish‑subscribe model, storage structures, load‑balancing, long‑polling, concurrent and ordered consumption flows, progress persistence, and retry mechanisms, with illustrative diagrams and code snippets.

ConsumerMessage QueueRetry
0 likes · 28 min read
Understanding RocketMQ Consumption Logic in Version 4.9.x
21CTO
21CTO
Jul 15, 2023 · Backend Development

From ActiveMQ to Pulsar: The Evolution of Message Queues Explained

This article traces the development of message queues from early decoupling solutions like ActiveMQ and RabbitMQ, through high‑throughput designs such as Kafka and RocketMQ, to modern platform‑centric systems like Pulsar, while detailing core concepts, architecture diagrams, storage mechanisms and trade‑offs.

KafkaMessage QueueRocketMQ
0 likes · 15 min read
From ActiveMQ to Pulsar: The Evolution of Message Queues Explained
macrozheng
macrozheng
Jul 4, 2023 · Backend Development

Ensuring Cache‑DB Consistency with Canal, RabbitMQ, and Redis in SpringBoot

This guide walks through building a SpringBoot architecture that updates MySQL first, deletes Redis cache asynchronously via Canal and RabbitMQ, resolves common Canal meta‑data mismatches, and configures manual RabbitMQ acknowledgments to guarantee reliable cache invalidation.

Cache ConsistencyCanalMessage Queue
0 likes · 12 min read
Ensuring Cache‑DB Consistency with Canal, RabbitMQ, and Redis in SpringBoot
政采云技术
政采云技术
Jun 29, 2023 · Backend Development

Understanding RocketMQ: Architecture, Modules, and Deployment Essentials

This article provides a comprehensive overview of RocketMQ, covering its origin, core concepts, component roles, cluster deployment architecture, workflow, feature details, persistence mechanisms, and cleanup policies, offering developers a solid foundation for using this high‑performance messaging middleware.

ApacheMessage QueueMiddleware
0 likes · 18 min read
Understanding RocketMQ: Architecture, Modules, and Deployment Essentials
MaGe Linux Operations
MaGe Linux Operations
Jun 20, 2023 · Big Data

What Is Kafka? A Beginner’s Guide to Distributed Streaming and Messaging

Kafka is an open‑source, distributed streaming platform that uses a publish/subscribe message queue architecture to provide high‑throughput, fault‑tolerant real‑time data processing, featuring topics, partitions, replicas, consumer groups, and multiple APIs for producers, consumers, streams, connectors, and administration.

Big DataDistributed StreamingKafka
0 likes · 20 min read
What Is Kafka? A Beginner’s Guide to Distributed Streaming and Messaging
Sanyou's Java Diary
Sanyou's Java Diary
Jun 15, 2023 · Databases

Mastering Redis Pub/Sub: Channels, Patterns, and Real-World Use Cases

This article explains Redis Pub/Sub fundamentals, demonstrates channel‑based and pattern‑based subscription with command‑line examples, dives into the internal data structures that power them, and shows how to integrate Redis Pub/Sub in Spring Boot using Redisson for lightweight messaging.

Message QueueRedisdatabases
0 likes · 14 min read
Mastering Redis Pub/Sub: Channels, Patterns, and Real-World Use Cases
Sanyou's Java Diary
Sanyou's Java Diary
Jun 12, 2023 · Backend Development

Master RocketMQ 4.9.x Consumption: Architecture, Load Balancing, and Retry Strategies

This article walks through RocketMQ 4.9.x’s consumption architecture, explaining the roles of NameServer, Broker, Producer and Consumer, the publish‑subscribe model, storage structures, load‑balancing algorithms, long‑polling, concurrent and ordered consumption, progress persistence, and the built‑in retry mechanism.

ConsumerMessage QueueRetry Mechanism
0 likes · 28 min read
Master RocketMQ 4.9.x Consumption: Architecture, Load Balancing, and Retry Strategies
Architect's Guide
Architect's Guide
Jun 6, 2023 · Backend Development

Kafka Core Concepts, Architecture, Performance Tuning, and Cluster Capacity Planning

This article provides a comprehensive overview of Kafka, covering its core value for decoupling and asynchronous processing, fundamental concepts such as producers, consumers, topics, partitions and replication, high‑performance mechanisms like zero‑copy and OS cache, detailed resource evaluation for CPU, memory, disk and network, operational tools, consumer‑group rebalance strategies, LEO/HW offsets, controller management, and delayed‑task scheduling.

Cluster PlanningConsumer GroupKafka
0 likes · 29 min read
Kafka Core Concepts, Architecture, Performance Tuning, and Cluster Capacity Planning
Top Architect
Top Architect
Jun 5, 2023 · Big Data

Deep Dive into Kafka’s High Reliability and High Performance Mechanisms

This article comprehensively explores Kafka’s core concepts, architecture, and the techniques it employs—such as ack strategies, replica synchronization, high‑watermark, leader‑epoch, zero‑copy, batch sending, compression, and reactor‑based networking—to achieve both strong reliability and high throughput in distributed messaging systems.

KafkaMessage QueueReliability
0 likes · 31 min read
Deep Dive into Kafka’s High Reliability and High Performance Mechanisms
php Courses
php Courses
May 18, 2023 · Backend Development

Implementing Message Queues with PHP and RabbitMQ

This article explains how to set up a PHP development environment, install RabbitMQ and its dependencies, and provides complete producer and consumer code examples to create a simple "Hello World" message queue using RabbitMQ's AMQP protocol.

AMQPAsynchronousMessage Queue
0 likes · 7 min read
Implementing Message Queues with PHP and RabbitMQ
WeChat Backend Team
WeChat Backend Team
May 17, 2023 · Big Data

Boosting Real-Time Recommendations: Apache Pulsar Optimizations at WeChat

This article details how WeChat's Gemini‑2.0 big‑data platform leverages Apache Pulsar, outlining cloud‑native advantages, load‑balancing refinements, cache and SSD tuning, high‑availability safeguards, and cost‑saving strategies that together enable large‑scale, real‑time, deep‑learning recommendation workloads.

Apache PulsarBig DataMessage Queue
0 likes · 17 min read
Boosting Real-Time Recommendations: Apache Pulsar Optimizations at WeChat
Top Architect
Top Architect
May 15, 2023 · Backend Development

Comprehensive Guide to Kafka: Architecture, Performance Tuning, and Operational Practices

This article provides an in-depth overview of Kafka, covering its core value as a message queue, fundamental concepts, cluster architecture, producer and consumer configurations, scaling strategies, monitoring tools, and practical operational commands for building and maintaining high‑throughput, highly available streaming systems.

KafkaMessage QueuePerformance Tuning
0 likes · 31 min read
Comprehensive Guide to Kafka: Architecture, Performance Tuning, and Operational Practices
Top Architect
Top Architect
May 6, 2023 · Backend Development

Netty TCP Client Demo with Spring Boot: Architecture, Message Queue, and Complete Code Walkthrough

An in‑depth tutorial demonstrates building a Netty‑based TCP client with Spring Boot, covering project architecture, module layout, message‑queue simulation, detailed Java code for client creation, connection handling, and testing endpoints, providing a complete, production‑ready demo for IoT socket communication.

JavaMessage QueueNetty
0 likes · 26 min read
Netty TCP Client Demo with Spring Boot: Architecture, Message Queue, and Complete Code Walkthrough
IT Services Circle
IT Services Circle
May 5, 2023 · Backend Development

Implementing Cache‑Database Consistency with Canal, MySQL, Redis and RabbitMQ

This article demonstrates how to achieve cache‑database consistency by updating MySQL first, deleting Redis cache asynchronously via Canal, publishing change events to RabbitMQ, and handling acknowledgments manually in a Spring Boot application, complete with configuration steps and troubleshooting tips.

Cache invalidationCanalMessage Queue
0 likes · 11 min read
Implementing Cache‑Database Consistency with Canal, MySQL, Redis and RabbitMQ
ITPUB
ITPUB
May 2, 2023 · Backend Development

Four Ways to Sync MySQL Data to Elasticsearch – Pros, Cons, and Tools

This article compares four common approaches for synchronizing MySQL data to Elasticsearch—synchronous dual write, asynchronous dual write via message queues, scheduled tasks, and binlog‑based data subscription—detailing their advantages, drawbacks, implementation steps, and tool choices such as Canal, Maxwell, and Python‑MySQL‑Replication.

CanalElasticsearchMessage Queue
0 likes · 6 min read
Four Ways to Sync MySQL Data to Elasticsearch – Pros, Cons, and Tools
Top Architect
Top Architect
Apr 30, 2023 · Backend Development

Kafka Core Concepts, Architecture, Performance, and Operational Practices

This article provides a comprehensive overview of Kafka, covering its core value as a message queue, fundamental concepts, cluster architecture, log storage mechanisms, zero‑copy data transfer, high‑throughput and high‑availability design, consumer group behavior, rebalance strategies, and practical operational commands for managing topics, partitions, and offsets.

KafkaMessage Queuebackend
0 likes · 31 min read
Kafka Core Concepts, Architecture, Performance, and Operational Practices
Architecture Digest
Architecture Digest
Apr 23, 2023 · Backend Development

Kafka Core Concepts, Architecture, Performance Optimizations, and Production Deployment Guide

This article provides a comprehensive technical overview of Kafka, covering its core message‑queue value, architecture components such as producers, consumers, topics, partitions and replication, high‑performance mechanisms like zero‑copy and OS cache, resource planning for disks, memory, CPU and network, operational tools and commands, consumer‑group management, rebalance strategies, and internal scheduling mechanisms such as the time‑wheel.

KafkaMessage QueuePerformance Tuning
0 likes · 30 min read
Kafka Core Concepts, Architecture, Performance Optimizations, and Production Deployment Guide
Big Data Technology Architecture
Big Data Technology Architecture
Apr 22, 2023 · Big Data

Deep Dive into Kafka’s High Reliability and High Performance Mechanisms

This article comprehensively explores Kafka’s core architecture, explaining how asynchronous decoupling and traffic shaping are achieved, detailing the roles of producers, brokers, consumers, and ZooKeeper, and analyzing the reliability and performance techniques such as ACK policies, replication, idempotent and transactional producers, page‑cache flushing, zero‑copy, compression, batching, and load‑balancing strategies.

Message QueueReliabilitydistributed systems
0 likes · 31 min read
Deep Dive into Kafka’s High Reliability and High Performance Mechanisms
Wukong Talks Architecture
Wukong Talks Architecture
Apr 15, 2023 · Backend Development

Design and Implementation of RocketMQ Tiered Storage

The article explains how RocketMQ 5.1.0 introduces a tiered storage module that offloads messages to cheaper media, describes its design, architecture layers, quick‑start configuration, upload and read mechanisms, prefetch cache, fault recovery, current development plans, and remaining challenges.

Message QueueRocketMQTiered Storage
0 likes · 13 min read
Design and Implementation of RocketMQ Tiered Storage
Tencent Cloud Middleware
Tencent Cloud Middleware
Apr 13, 2023 · Fundamentals

RocketMQ, Kafka, Pulsar: Core Concepts, Architecture & Transactional Messaging

This article provides a comprehensive overview of major message‑queue middleware—including RocketMQ, Kafka, Pulsar, and RabbitMQ—covering fundamental concepts such as tags, groups, offsets, architectural components, storage mechanisms, transaction workflows, rebalance strategies, and recent developments, while comparing their features and performance characteristics.

KafkaMessage QueueMiddleware
0 likes · 19 min read
RocketMQ, Kafka, Pulsar: Core Concepts, Architecture & Transactional Messaging
Code Ape Tech Column
Code Ape Tech Column
Apr 11, 2023 · Backend Development

Comprehensive Comparison of Kafka, RabbitMQ, ZeroMQ, RocketMQ, and ActiveMQ

This article provides a detailed side‑by‑side comparison of five popular message‑queue systems—Kafka, RabbitMQ, ZeroMQ, RocketMQ, and ActiveMQ—covering documentation, programming languages, supported protocols, storage, transactions, load balancing, clustering, management UI, availability, duplication handling, throughput, subscription models, ordering, acknowledgments, replay, retry, concurrency, and includes promotional information from the author.

ActiveMQComparisonKafka
0 likes · 24 min read
Comprehensive Comparison of Kafka, RabbitMQ, ZeroMQ, RocketMQ, and ActiveMQ
IT Architects Alliance
IT Architects Alliance
Apr 11, 2023 · Backend Development

How to Build a High‑Performance Flash‑Sale System: Architecture & Best Practices

This article outlines a comprehensive flash‑sale system architecture covering front‑end separation, Nginx static handling, traffic shaping, Redis caching and locking, message‑queue throttling, database sharding, and captcha mechanisms to achieve high concurrency while ensuring security and reliability.

Message QueueRedisSystem Architecture
0 likes · 11 min read
How to Build a High‑Performance Flash‑Sale System: Architecture & Best Practices
Selected Java Interview Questions
Selected Java Interview Questions
Apr 7, 2023 · Backend Development

Designing a High‑Concurrency Flash Sale (秒杀) System Architecture

This article explains the architecture of a flash‑sale system from seven dimensions, covering characteristics, overall design, peak‑limiting, security, page optimization, asynchronous processing, hotspot isolation, Nginx configuration, Redis clustering, message‑queue throttling, database design, and captcha mechanisms to handle massive concurrent requests.

Message QueueSystem Architectureflash sale
0 likes · 11 min read
Designing a High‑Concurrency Flash Sale (秒杀) System Architecture
360 Quality & Efficiency
360 Quality & Efficiency
Apr 7, 2023 · Backend Development

RabbitMQ Introduction: Installation, Basic and Advanced Producer/Consumer Patterns, Exchanges, and Common Issues

This guide introduces RabbitMQ, explains how to install it with Docker, covers basic and advanced producer/consumer usage including acknowledgments, durability, QoS, bindings, and exchange types, and discusses a typical Python reconnection problem, providing a practical overview for backend developers.

DockerExchangeMessage Queue
0 likes · 5 min read
RabbitMQ Introduction: Installation, Basic and Advanced Producer/Consumer Patterns, Exchanges, and Common Issues
dbaplus Community
dbaplus Community
Apr 3, 2023 · Operations

How to Guarantee Zero Message Loss in Kafka: Practical Detection and Prevention Strategies

This article explains why MQ middleware like Kafka is introduced for system decoupling and traffic control, outlines the three key challenges of message loss detection, loss points, and prevention, and provides detailed configurations, monitoring tips, and code examples to ensure reliable, loss‑free message delivery.

ConfigurationConsumerData Consistency
0 likes · 12 min read
How to Guarantee Zero Message Loss in Kafka: Practical Detection and Prevention Strategies
Sanyou's Java Diary
Sanyou's Java Diary
Apr 3, 2023 · Backend Development

How RocketMQ’s Storage Model Powers Fast Message Retrieval

This article breaks down RocketMQ’s storage architecture, explaining how its commitlog, consumequeue, and index files work together to ensure reliable persistence, quick offset-based lookups, and efficient message consumption in a publish‑subscribe model.

CommitLogConsumeQueueIndexFile
0 likes · 9 min read
How RocketMQ’s Storage Model Powers Fast Message Retrieval
Code Ape Tech Column
Code Ape Tech Column
Mar 30, 2023 · Backend Development

How to Ensure No Message Loss in MQ Systems – Interview Guide and Practical Solutions

This article explains the common interview question of guaranteeing 100% message reliability in MQ middleware such as Kafka or RabbitMQ, outlines the three lifecycle stages of a message, discusses detection mechanisms, id generation, idempotent consumption, and handling message backlog, providing concrete design patterns and practical examples.

KafkaMessage QueueReliability
0 likes · 12 min read
How to Ensure No Message Loss in MQ Systems – Interview Guide and Practical Solutions
Laravel Tech Community
Laravel Tech Community
Mar 22, 2023 · Backend Development

Designing a High-Concurrency Flash Sale System Architecture

This article explains the key characteristics of flash‑sale (秒杀) business and presents a comprehensive backend architecture—including Nginx, CDN, gateway, Redis, MQ, asynchronous processing, hotspot isolation, and database strategies—to handle massive simultaneous requests while ensuring performance, reliability, and security.

Message QueueSystem Architectureflash sale
0 likes · 11 min read
Designing a High-Concurrency Flash Sale System Architecture
Su San Talks Tech
Su San Talks Tech
Mar 22, 2023 · Backend Development

Why Does RocketMQ Duplicate Message Consumption? Root Causes Explained

This article examines the various reasons why RocketMQ can deliver the same message to consumers multiple times, covering send‑retry mechanisms, consumer‑side exceptions, offset commit and persistence failures, master‑slave synchronization issues, rebalance events, and long‑processing cleanup, and offers guidance on designing idempotent solutions.

Message QueueOffset ManagementRetry Mechanism
0 likes · 15 min read
Why Does RocketMQ Duplicate Message Consumption? Root Causes Explained
JD Retail Technology
JD Retail Technology
Mar 2, 2023 · Databases

Evolution of JD VOP Message Warehouse: From V1.0 to V3.0+ with Database Sharding and Performance Optimization

This article details the architectural evolution of JD's VOP message warehouse, describing the challenges of massive data volumes, the transition from V1.0 to V3.0+ through database sharding, MongoDB adoption, traffic governance, stability improvements, and cost reduction strategies, while presenting performance metrics and future outlook.

Message QueueMongoDBbackend systems
0 likes · 17 min read
Evolution of JD VOP Message Warehouse: From V1.0 to V3.0+ with Database Sharding and Performance Optimization
Sanyou's Java Diary
Sanyou's Java Diary
Feb 27, 2023 · Backend Development

11 Ways to Implement Delayed Tasks in Java – From DelayQueue to Redis and MQ

This article surveys eleven practical techniques for implementing delayed tasks in Java, covering JDK utilities like DelayQueue, Timer, and ScheduledThreadPoolExecutor, as well as message‑queue solutions such as RocketMQ, RabbitMQ, Redis key‑expiration, Redisson, Netty, Hutool, Quartz, and simple polling, with code demos and implementation principles.

Message QueueRedisdelayed tasks
0 likes · 26 min read
11 Ways to Implement Delayed Tasks in Java – From DelayQueue to Redis and MQ
Su San Talks Tech
Su San Talks Tech
Feb 24, 2023 · Backend Development

Why We’re Dropping RabbitMQ for Kafka: A Complete Migration Blueprint

Facing chaotic usage, maintenance challenges, partition tolerance issues, and performance bottlenecks with RabbitMQ, our middleware team decided to fully migrate to Kafka, outlining reasons, comparative models, migration strategies, and verification steps to ensure a smooth, high‑availability, high‑performance transition.

KafkaMessage Queuebackend
0 likes · 13 min read
Why We’re Dropping RabbitMQ for Kafka: A Complete Migration Blueprint
Java High-Performance Architecture
Java High-Performance Architecture
Feb 22, 2023 · Backend Development

8 Powerful Ways to Implement Asynchronous Programming in Java

This article explores eight Java asynchronous programming techniques—from raw threads and Future to CompletableFuture, Spring @Async, event-driven approaches, message queues, Hutool ThreadUtil, and Guava ListenableFuture—detailing their concepts, advantages, limitations, and providing complete code examples for each.

AsynchronousCompletableFutureFuture
0 likes · 14 min read
8 Powerful Ways to Implement Asynchronous Programming in Java
MaGe Linux Operations
MaGe Linux Operations
Feb 18, 2023 · Backend Development

8 Powerful Ways to Implement Asynchronous Programming in Java

This article explains why asynchronous execution improves latency in common scenarios like sending SMS or emails, and presents eight Java techniques—including threads, Future, CompletableFuture, Spring @Async, ApplicationEvent, message queues, third‑party utilities, and Guava—to implement robust asynchronous programming.

Asynchronous ProgrammingCompletableFutureFuture
0 likes · 14 min read
8 Powerful Ways to Implement Asynchronous Programming in Java
Tencent Cloud Middleware
Tencent Cloud Middleware
Feb 15, 2023 · Cloud Native

Tencent Cloud’s Secrets to Scaling Apache Pulsar: Stability & Performance Hacks

This article details Tencent Cloud's year‑long production experience with Apache Pulsar, covering why Pulsar was chosen over Kafka, deep dives into Ack hole handling, TTL/Backlog/Retention strategies, zk‑node and ledger leaks, cache optimizations, and concrete code snippets that illustrate the stability and performance improvements.

Apache PulsarMessage QueueStability
0 likes · 18 min read
Tencent Cloud’s Secrets to Scaling Apache Pulsar: Stability & Performance Hacks
ITPUB
ITPUB
Feb 12, 2023 · Backend Development

Uncovering RocketMQ Sync Lag: Why Messages Reach the Broker but Not the Consumer

A detailed investigation reveals that RocketMQ can report successful writes to the broker while consumers see minutes‑long delays because the transient store pool and commit‑log forwarding mechanisms delay the transfer of messages from the broker’s memory to the consumer queue.

JavaLag DiagnosisMessage Queue
0 likes · 10 min read
Uncovering RocketMQ Sync Lag: Why Messages Reach the Broker but Not the Consumer
Architect
Architect
Feb 4, 2023 · Backend Development

Understanding the Consumer Startup Process in RocketMQ (Pull Mode)

This article explains RocketMQ's consumer startup process in pull mode, detailing the underlying push‑like implementation, configuration validation, instance naming, client initialization, load‑balancing, wrapper handling, offset storage, scheduled tasks, and trace dispatching, accompanied by Java code examples.

ConsumerJavaMessage Queue
0 likes · 11 min read
Understanding the Consumer Startup Process in RocketMQ (Pull Mode)
Su San Talks Tech
Su San Talks Tech
Feb 1, 2023 · Backend Development

How to Sync MySQL Data to Elasticsearch: 4 Practical Strategies

This article explores four common approaches for synchronizing product data from MySQL to Elasticsearch in e‑commerce systems—synchronous dual write, asynchronous dual write with message queues, scheduled tasks, and binlog‑based data subscription—detailing their advantages, drawbacks, and implementation considerations.

CanalData synchronizationElasticsearch
0 likes · 7 min read
How to Sync MySQL Data to Elasticsearch: 4 Practical Strategies
macrozheng
macrozheng
Jan 31, 2023 · Backend Development

How to Sync MySQL Data to Elasticsearch: 4 Practical Strategies

This article explores four common approaches for synchronizing product data from MySQL to Elasticsearch—including synchronous dual writes, asynchronous messaging, scheduled jobs, and binlog‑based data subscription—detailing their advantages, drawbacks, and implementation considerations for e‑commerce search systems.

Data synchronizationElasticsearchMessage Queue
0 likes · 6 min read
How to Sync MySQL Data to Elasticsearch: 4 Practical Strategies
ITPUB
ITPUB
Jan 30, 2023 · Backend Development

How to Keep MySQL and Elasticsearch in Sync: 4 Practical Strategies

This article examines four common approaches for synchronizing product data from MySQL to Elasticsearch—synchronous dual write, asynchronous dual write with message queues, scheduled batch jobs, and binlog‑based data subscription—detailing their advantages, drawbacks, and implementation considerations.

CanalData synchronizationElasticsearch
0 likes · 6 min read
How to Keep MySQL and Elasticsearch in Sync: 4 Practical Strategies
Cognitive Technology Team
Cognitive Technology Team
Jan 19, 2023 · Databases

Implementation Principles of Redis Pub/Sub (Ordinary Subscription)

This article explains how Redis implements the Pub/Sub messaging pattern by storing subscription relationships in hash‑based dictionaries, detailing the processing flow of SUBSCRIBE and PUBLISH commands, cluster propagation, and key limitations such as lack of persistence and client buffer constraints.

Message QueueRedisdatabases
0 likes · 5 min read
Implementation Principles of Redis Pub/Sub (Ordinary Subscription)
Code Ape Tech Column
Code Ape Tech Column
Jan 18, 2023 · Backend Development

Eight Ways to Implement Asynchronous Execution in Java

This article introduces eight practical techniques for achieving asynchronous processing in Java—including raw threads, Future, CompletableFuture, Spring @Async, ApplicationEvent, message queues, Hutool ThreadUtil, and Guava ListenableFuture—complete with code examples and discussion of their advantages and limitations.

AsynchronousFutureGuava
0 likes · 14 min read
Eight Ways to Implement Asynchronous Execution in Java
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Jan 10, 2023 · Backend Development

Key Differences Between RPC and Message Queues (MQ) in Distributed Systems

This article explains the core distinctions between Remote Procedure Call (RPC) and Message Queue (MQ) technologies, covering their architectures, communication patterns, functional features, and performance considerations, and outlines typical use cases such as synchronous calls, decoupling, traffic shaping, and asynchronous processing in distributed systems.

Message QueueRPCbackend development
0 likes · 6 min read
Key Differences Between RPC and Message Queues (MQ) in Distributed Systems
Sanyou's Java Diary
Sanyou's Java Diary
Jan 9, 2023 · Backend Development

Unveiling the Full Lifecycle of a RocketMQ Message: From Production to Deletion

This article walks through every stage of a RocketMQ message—how producers create and route messages, the storage mechanisms and zero‑copy techniques used by brokers, high‑availability modes, consumption models, ordering guarantees, and the automatic cleanup policies that finally retire messages.

Message QueueRocketMQhigh availability
0 likes · 26 min read
Unveiling the Full Lifecycle of a RocketMQ Message: From Production to Deletion
Top Architect
Top Architect
Jan 5, 2023 · Backend Development

Design and Architecture of a One‑to‑One Instant Messaging System

This article analyzes the functional decomposition, data structures, system architecture, push‑pull mode selection, and message flow of a one‑to‑one instant messaging service, providing practical design guidelines and example Redis/MySQL schemas for building a scalable chat backend.

Instant MessagingMessage QueueRedis
0 likes · 13 min read
Design and Architecture of a One‑to‑One Instant Messaging System
Java High-Performance Architecture
Java High-Performance Architecture
Dec 29, 2022 · Backend Development

Why Message Queues Are Essential: Decoupling, Asynchrony, and Pitfalls Explained

This article explains why message queues are used to decouple services, enable asynchronous processing, smooth traffic spikes, and improve performance, while also detailing the new challenges they introduce such as reduced availability, increased complexity, duplicate consumption, data consistency, message loss, ordering, and backlog, along with practical solutions for each issue.

Backlog ManagementData ConsistencyDecoupling
0 likes · 18 min read
Why Message Queues Are Essential: Decoupling, Asynchrony, and Pitfalls Explained
Architecture & Thinking
Architecture & Thinking
Dec 28, 2022 · Backend Development

Ensuring Idempotency in Message Queues: Strategies for Reliable Messaging

This article explains the concept of idempotency, illustrates why repeated operations must yield identical results, and details how RocketMQ’s components—NameServer, Broker, Producer, and Consumer—can be designed with unique message IDs and acknowledgment mechanisms to achieve reliable, duplicate‑free messaging in backend systems.

Message QueueRocketMQbackend
0 likes · 10 min read
Ensuring Idempotency in Message Queues: Strategies for Reliable Messaging
Alibaba Cloud Native
Alibaba Cloud Native
Dec 27, 2022 · Cloud Native

Contribute to Apache RocketMQ 5.0 SDK: New Cloud‑Native Features & How‑to Guide

Apache RocketMQ 5.0 introduces a stateless proxy, gRPC‑based multi‑language SDK with immutable APIs, enhanced error handling, SimpleConsumer, and pop consumption, and the article outlines the technical improvements, roadmap, and step‑by‑step guide for developers to set up the environment, understand the new protocols, and contribute language client implementations.

Message QueueRocketMQSDK
0 likes · 8 min read
Contribute to Apache RocketMQ 5.0 SDK: New Cloud‑Native Features & How‑to Guide
Su San Talks Tech
Su San Talks Tech
Dec 20, 2022 · Backend Development

Master RabbitMQ: From Core Concepts to Real‑World Implementation

This comprehensive guide walks you through RabbitMQ fundamentals, deployment on macOS, core concepts such as exchanges and routing, detailed code examples for producers and consumers in Java, and advanced features like TTL, dead‑letter queues, and manual acknowledgments, helping you bridge theory and practice in message‑queue systems.

AMQPJavaMessage Queue
0 likes · 36 min read
Master RabbitMQ: From Core Concepts to Real‑World Implementation
Code Ape Tech Column
Code Ape Tech Column
Dec 20, 2022 · Backend Development

Building a High‑Availability RocketMQ Cluster (Version 4.9.4)

This tutorial explains why message queues are essential, compares popular MQ products, details RocketMQ's core components, and provides step‑by‑step instructions—including environment setup, broker configuration, firewall rules, and monitoring—to deploy a fault‑tolerant RocketMQ cluster on CentOS 7.

ClusterMessage QueueMiddleware
0 likes · 23 min read
Building a High‑Availability RocketMQ Cluster (Version 4.9.4)
Laravel Tech Community
Laravel Tech Community
Dec 19, 2022 · Cloud Native

Understanding RocketMQ Load Balancing Mechanism and Best Practices

This article explains RocketMQ's load balancing process, including when rebalancing occurs, the impact on message consumption, common strategies such as average allocation and consistent hashing, and practical recommendations like minimizing client churn and choosing appropriate strategies for cloud‑native deployments.

ConsumerMessage QueueRocketMQ
0 likes · 8 min read
Understanding RocketMQ Load Balancing Mechanism and Best Practices
Alibaba Cloud Native
Alibaba Cloud Native
Dec 9, 2022 · Cloud Native

How to Build a Low‑Cost, High‑Throughput Serverless Message Consumer on Alibaba Cloud

This guide explains how to use Alibaba Cloud's Serverless Function Compute together with Message Service and Connector to create a cost‑effective, high‑throughput, low‑latency message‑consumption pipeline, covering architecture, key features, step‑by‑step configuration, code examples, and best‑practice recommendations.

Alibaba CloudConnectorFunction Compute
0 likes · 18 min read
How to Build a Low‑Cost, High‑Throughput Serverless Message Consumer on Alibaba Cloud
IT Architects Alliance
IT Architects Alliance
Nov 24, 2022 · Backend Development

Transaction Consistency Strategies in Microservices: Blocking Retry, Async Queues, TCC, and Local Message Tables

The article examines common microservice transaction consistency techniques—including blocking retries, asynchronous queues, TCC compensation transactions, local message tables, and MQ transactions—explaining their mechanisms, advantages, drawbacks, and practical code examples for ensuring data integrity across distributed services.

Message QueueRetryTCC
0 likes · 13 min read
Transaction Consistency Strategies in Microservices: Blocking Retry, Async Queues, TCC, and Local Message Tables
Top Architect
Top Architect
Nov 23, 2022 · Backend Development

Transaction Consistency Strategies in Distributed Microservices: Blocking Retry, Asynchronous Queue, TCC, and Local Message Table

The article explains various techniques for ensuring data consistency in distributed microservice architectures, including blocking retries, asynchronous queues, TCC compensation transactions, local message tables, and MQ transactions, while discussing their advantages, drawbacks, and practical implementation details.

Message QueueTCCbackend
0 likes · 15 min read
Transaction Consistency Strategies in Distributed Microservices: Blocking Retry, Asynchronous Queue, TCC, and Local Message Table
macrozheng
macrozheng
Nov 15, 2022 · Backend Development

From ActiveMQ to RocketMQ: My Journey Through Message Queues and Lessons Learned

This article chronicles the author's four‑stage evolution with message queues—from early experiments with ActiveMQ, through Redis and RabbitMQ, to MetaQ and finally RocketMQ—highlighting practical challenges, architectural decisions, performance tuning, and insights for building robust, high‑throughput backend systems.

ActiveMQKafkaMessage Queue
0 likes · 28 min read
From ActiveMQ to RocketMQ: My Journey Through Message Queues and Lessons Learned
Architect's Guide
Architect's Guide
Nov 15, 2022 · Backend Development

RocketMQ Message Types, Sending Modes, Ordering, Delayed, Transactional, Batch, Filtering, Retry and Dead‑Letter Queues

This article provides a comprehensive overview of RocketMQ messaging concepts—including synchronous, asynchronous and one‑way sending, ordered and delayed messages, transaction handling, batch processing, tag/SQL filtering, retry mechanisms, and dead‑letter queue management—accompanied by Java code examples for each scenario.

JavaMessage QueueRocketMQ
0 likes · 36 min read
RocketMQ Message Types, Sending Modes, Ordering, Delayed, Transactional, Batch, Filtering, Retry and Dead‑Letter Queues
Sanyou's Java Diary
Sanyou's Java Diary
Nov 7, 2022 · Backend Development

Is Redis a Viable Message Queue? List, Pub/Sub, and Stream Compared

This article examines whether Redis can serve as a reliable message queue by exploring its List, Pub/Sub, and Stream data types, comparing their features, performance, and limitations, and ultimately guiding readers on suitable use cases versus professional queue solutions.

Message QueueRedisStream
0 likes · 27 min read
Is Redis a Viable Message Queue? List, Pub/Sub, and Stream Compared
IT Services Circle
IT Services Circle
Nov 2, 2022 · Backend Development

Implementing Gray (Canary) Messaging for RabbitMQ and Kafka

This article describes how to design and implement a gray (canary) messaging capability for RabbitMQ and Kafka, covering background, gray scenarios, two consumption strategies, and detailed production and consumption flows with code snippets for header tagging, requeue handling, and consumer group management.

Canary DeploymentKafkaMessage Queue
0 likes · 8 min read
Implementing Gray (Canary) Messaging for RabbitMQ and Kafka
Selected Java Interview Questions
Selected Java Interview Questions
Oct 26, 2022 · Backend Development

Choosing the Right Delayed‑Task Solution: Why Redis Expiration and RabbitMQ Dead‑Letter Queues Are Problematic

The article evaluates common approaches for implementing delayed tasks such as order‑closing, critiques unreliable methods like Redis expiration listeners and RabbitMQ dead‑letter queues, and recommends robust solutions like RocketMQ, Pulsar, or Redisson delay queues with proper compensation mechanisms.

Message QueueRedisbackend
0 likes · 8 min read
Choosing the Right Delayed‑Task Solution: Why Redis Expiration and RabbitMQ Dead‑Letter Queues Are Problematic
DataFunTalk
DataFunTalk
Oct 23, 2022 · Backend Development

Design and Implementation of a Lightweight Asynchronous Message Processing Framework for Data Catalog

This article describes the motivation, requirements, design, and implementation of a lightweight asynchronous message processing framework built by ByteDance to handle near‑real‑time metadata changes for DataLeap's Data Catalog, detailing its architecture, thread model, state management, delay handling, monitoring, and operational experiences.

Backend FrameworkKafkaMessage Queue
0 likes · 11 min read
Design and Implementation of a Lightweight Asynchronous Message Processing Framework for Data Catalog
Java High-Performance Architecture
Java High-Performance Architecture
Oct 14, 2022 · Backend Development

How to Guarantee Zero Message Loss in MQ Systems – Interview Mastery

Interviewers frequently probe candidates on ensuring 100% message reliability in MQ systems like Kafka or RabbitMQ, and this guide walks through the underlying concepts, potential loss points, detection mechanisms, idempotent design, handling backlog, and practical ID generation strategies to ace such questions.

KafkaMQ reliabilityMessage Queue
0 likes · 13 min read
How to Guarantee Zero Message Loss in MQ Systems – Interview Mastery
vivo Internet Technology
vivo Internet Technology
Oct 9, 2022 · Big Data

Design and Implementation of a Real-Time Marketing Automation Engine at vivo

This fifth installment explains vivo’s real‑time marketing automation engine, detailing its business need, layered architecture (access, processing, output, management, warehouse), scalable event‑queue design, dynamic configuration, unified dispatch, Flink‑based metric enrichment, and rule‑engine integration to achieve low‑latency, high‑throughput personalized targeting.

FlinkMessage QueueRule Engine
0 likes · 13 min read
Design and Implementation of a Real-Time Marketing Automation Engine at vivo
Top Architect
Top Architect
Oct 2, 2022 · Backend Development

Implementing Delayed Message Queues with RabbitMQ Plugin in Spring Boot

This article demonstrates how to use RabbitMQ's delayed‑queue plugin together with Spring Boot to create a lazy exchange, configure a durable queue, send messages with a specified delay, and consume them, providing complete Java code examples and explaining why this approach outperforms traditional Redis, database polling, or JVM DelayQueue solutions.

Delayed QueueMessage QueueSpring Boot
0 likes · 9 min read
Implementing Delayed Message Queues with RabbitMQ Plugin in Spring Boot
Alibaba Cloud Native
Alibaba Cloud Native
Sep 29, 2022 · Cloud Native

Why Use RocketMQ Connect for Scalable Data Pipelines?

This article explains the challenges of point‑to‑point data sync, introduces RocketMQ Connect as a cloud‑native solution that decouples upstream and downstream, details its architecture, connectors, REST API, metrics, deployment modes, and provides a step‑by‑step guide to building custom connectors for use cases such as CDC, data lakes, and system migration.

CDCConnectorData Integration
0 likes · 19 min read
Why Use RocketMQ Connect for Scalable Data Pipelines?
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Sep 28, 2022 · Backend Development

Why Use RabbitMQ? Principles, Architecture, Core Concepts, and Working Modes

This article explains why RabbitMQ is used for decoupling, asynchronous processing, and traffic shaping, describes its architecture and core components such as broker, exchange, queue, binding, routing key, vhost, producer, consumer, and channel, and outlines its six operating modes with illustrative diagrams.

Message Queueasynchronous processingbackend development
0 likes · 7 min read
Why Use RabbitMQ? Principles, Architecture, Core Concepts, and Working Modes
Tencent Cloud Middleware
Tencent Cloud Middleware
Sep 27, 2022 · Cloud Native

How Tencent Cloud Optimized Apache Pulsar for Million‑Topic Scale

This article details Tencent Cloud's year‑long practical optimizations for Apache Pulsar, covering Ack hole impacts, TTL/Backlog/Retention strategies, delayed‑message handling, Admin API blocking, ZooKeeper and BookKeeper leaks, and multi‑level cache improvements to achieve stable, high‑performance messaging at massive scale.

Apache PulsarBacklogMessage Queue
0 likes · 18 min read
How Tencent Cloud Optimized Apache Pulsar for Million‑Topic Scale
ITPUB
ITPUB
Sep 20, 2022 · Backend Development

How to Build a High‑Performance Game Event Queue with Redis and Lua

This article explains how to design a Redis‑based pseudo‑message queue that groups, limits, and batch‑processes game‑level behavior data using Lua scripts, achieving millisecond‑level latency, controlled queue length, and scalable production‑consumer throughput for large‑scale game analytics.

Game AnalyticsLuaMessage Queue
0 likes · 14 min read
How to Build a High‑Performance Game Event Queue with Redis and Lua
Top Architect
Top Architect
Sep 20, 2022 · Backend Development

Ensuring No Message Loss in MQ Systems: Interview Guide and Practical Solutions

This article explains how interviewers assess candidates on MQ reliability by discussing system decoupling, traffic control, the three stages of message flow, detection of loss, id generation, idempotent consumption, handling backlog, and scaling strategies for Kafka and similar brokers.

Interview TipsMQ reliabilityMessage Queue
0 likes · 12 min read
Ensuring No Message Loss in MQ Systems: Interview Guide and Practical Solutions
Code Ape Tech Column
Code Ape Tech Column
Sep 15, 2022 · Databases

Understanding Data Heterogeneity: Scenarios, Methods, and Implementation with Binlog, Canal, and MQ

This article explains the concept of data heterogeneity, outlines common use cases such as sharding and multi‑dimensional queries, and details practical implementation methods including full cloning, marked sync, binlog‑based replication with Canal, and MQ‑driven approaches, while providing deployment tips and references.

CanalElasticsearchMessage Queue
0 likes · 12 min read
Understanding Data Heterogeneity: Scenarios, Methods, and Implementation with Binlog, Canal, and MQ
ITPUB
ITPUB
Sep 13, 2022 · Backend Development

When to Choose Kafka Over RabbitMQ? 6 Real‑World Scenarios Compared

This article compares Kafka and RabbitMQ across six practical scenarios—message ordering, routing, delayed processing, persistence, error handling, and throughput—explaining each system's strengths and weaknesses to help engineers make an informed queue‑selection decision.

ComparisonMessage Queuerabbitmq
0 likes · 13 min read
When to Choose Kafka Over RabbitMQ? 6 Real‑World Scenarios Compared
ITPUB
ITPUB
Sep 9, 2022 · Databases

Can Redis Streams Replace Kafka? A Practical Comparison

While Kafka dominates large‑scale messaging, this article shows how Redis Streams—an in‑memory, low‑cost alternative—can handle peak‑shaving, buffering, decoupling, redundancy, and robustness, offering simpler commands and higher speed for projects where deploying a full Kafka stack is overkill.

In-Memory DatabaseMessage QueueRedis
0 likes · 7 min read
Can Redis Streams Replace Kafka? A Practical Comparison
Top Architect
Top Architect
Sep 9, 2022 · Backend Development

Ensuring Reliable Message Delivery with Kafka: Preventing Message Loss

This article explains how to use a message queue like Kafka to decouple systems and control traffic, identifies the three main points where message loss can occur—producer, broker, and consumer—and provides practical detection methods and configuration recommendations to guarantee reliable, loss‑free message delivery.

Data ConsistencyMessage QueueMonitoring
0 likes · 12 min read
Ensuring Reliable Message Delivery with Kafka: Preventing Message Loss
Architect
Architect
Sep 8, 2022 · Backend Development

Ensuring No Message Loss in MQ Systems: Interview Guide and Practical Solutions

This article explains how to answer interview questions about guaranteeing 100% message delivery in MQ middleware such as Kafka, RabbitMQ, or RocketMQ, covering system decoupling, message lifecycle stages, reliability mechanisms, idempotent consumption, unique ID generation, and handling message back‑pressure.

Message QueueReliabilityidempotency
0 likes · 12 min read
Ensuring No Message Loss in MQ Systems: Interview Guide and Practical Solutions
Past Memory Big Data
Past Memory Big Data
Sep 8, 2022 · Backend Development

Implementing Fixed-Length Queues and Batch Consumption in Redis with Lua

The article details how a gaming data‑reporting pipeline uses Redis lists, sets and Lua scripts to build a pseudo‑message queue that provides per‑game message grouping, fixed‑length queues, and batch consumption while meeting strict timeliness and throughput requirements.

Batch ProcessingFixed-length queueLua
0 likes · 12 min read
Implementing Fixed-Length Queues and Batch Consumption in Redis with Lua
macrozheng
macrozheng
Sep 8, 2022 · Backend Development

Why Do Payment Orders Disappear? Causes and Prevention Strategies for E‑Commerce

The article explains why e‑commerce users sometimes see their payments completed in the wallet but the order remains unpaid, analyzes internal and external drop‑order scenarios, and provides practical server‑side, client‑side, and active‑query techniques—including scheduled tasks and delayed‑message queues—to prevent such issues.

Message Queueactive querybackend
0 likes · 13 min read
Why Do Payment Orders Disappear? Causes and Prevention Strategies for E‑Commerce
IT Architects Alliance
IT Architects Alliance
Sep 6, 2022 · Operations

How to Guarantee Zero Message Loss with Kafka: Best Practices and Configurations

This article explains why introducing a message queue like Kafka helps decouple systems and control traffic, then dives into the three key questions of detecting, locating, and preventing message loss, offering concrete monitoring methods, configuration settings, and troubleshooting steps for producers, brokers, and consumers.

BrokerConfigurationConsumer
0 likes · 13 min read
How to Guarantee Zero Message Loss with Kafka: Best Practices and Configurations
IT Architects Alliance
IT Architects Alliance
Sep 6, 2022 · Backend Development

Building a High‑Performance, Scalable IM System with Go and WebSocket

This article explains the fundamentals of instant‑messaging, dives deep into the WebSocket protocol and its handshake, and provides a step‑by‑step guide with Go code to quickly build a high‑availability, extensible IM system that supports registration, login, single‑chat, group‑chat, file upload and optimization strategies.

GoIM SystemMessage Queue
0 likes · 38 min read
Building a High‑Performance, Scalable IM System with Go and WebSocket
ITPUB
ITPUB
Sep 5, 2022 · Backend Development

How to Choose the Right Message Queue: Kafka, RabbitMQ, RocketMQ, and ActiveMQ Compared

This comprehensive guide explains the core concepts, deployment modes, evaluation criteria, and detailed pros and cons of the four major message‑queue platforms—Kafka, RabbitMQ, RocketMQ, and ActiveMQ—helping engineers make informed decisions for interview preparation and system design.

ActiveMQMessage QueueRocketMQ
0 likes · 43 min read
How to Choose the Right Message Queue: Kafka, RabbitMQ, RocketMQ, and ActiveMQ Compared
Xiao Lou's Tech Notes
Xiao Lou's Tech Notes
Sep 5, 2022 · Backend Development

How to Prevent Payment Order Loss (Drop Orders) in E‑Commerce Systems

This article explains why payment orders can disappear after a successful wallet transaction, outlines the complete payment flow, distinguishes internal and external drop‑order scenarios, and provides practical server‑side and client‑side strategies—including retry mechanisms, reliable async messaging, scheduled queries, and delayed‑message approaches—to reliably prevent such issues.

Message QueueReliabilitybackend
0 likes · 13 min read
How to Prevent Payment Order Loss (Drop Orders) in E‑Commerce Systems
dbaplus Community
dbaplus Community
Sep 3, 2022 · Backend Development

Can Redis Streams Replace Kafka for Your Messaging Needs?

The article explains how Redis Streams offers a lightweight, memory‑based alternative to Kafka, detailing its features, consumer‑group model, performance advantages, and suitable use cases while acknowledging scenarios where a full‑featured message queue remains preferable.

KafkaMessage QueueRedis
0 likes · 7 min read
Can Redis Streams Replace Kafka for Your Messaging Needs?