BestHub
Sign in
Tagged articles
970 articles
Page 9 of 10
Big Data Technology & Architecture
Big Data Technology & Architecture
Nov 3, 2019 · Backend Development

RocketMQ Practices and Disaster‑Recovery Architecture at ByteDance

This article summarizes Shen Hui’s presentation on how ByteDance adopted RocketMQ in a massive micro‑service environment, detailing the business background, reasons for choosing RocketMQ, the proxy‑based deployment, encountered challenges, and the multi‑data‑center disaster‑recovery solutions implemented.

Message QueueProxy ArchitectureRocketMQ
0 likes · 13 min read
RocketMQ Practices and Disaster‑Recovery Architecture at ByteDance
Big Data Technology & Architecture
Big Data Technology & Architecture
Oct 31, 2019 · Backend Development

Designing a High-Concurrency Flash Sale System Using Redis Caching and Lua Scripts

This article explains how to design a high‑concurrency flash‑sale (秒杀) system by leveraging browser and CDN caching, read‑write split Redis for traffic filtering, Lua scripts for atomic stock deduction, master‑slave Redis for fast inventory updates, and Redis‑based message queues for asynchronous order processing.

Backend ArchitectureLuaMessage Queue
0 likes · 8 min read
Designing a High-Concurrency Flash Sale System Using Redis Caching and Lua Scripts
macrozheng
macrozheng
Oct 18, 2019 · Backend Development

How Message Queues Boost Decoupling and Reliability in Production Systems

This article explains how using message queues for asynchronous communication decouples services, improves fault tolerance, and enhances performance, illustrated with a real‑world early‑education app case and a guide to employing dead‑letter queues for handling failed messages.

Dead Letter QueueDecouplingMessage Queue
0 likes · 9 min read
How Message Queues Boost Decoupling and Reliability in Production Systems
Programmer DD
Programmer DD
Oct 2, 2019 · Backend Development

How to Build a Reliable, Secure, and Scalable IM Server from Scratch

This article walks through constructing a lightweight instant‑messaging backend, covering version 1.0.0 features, reliability guarantees, application‑level ACK handling, security encryption, database schema for users, relations and offline messages, and storage strategies to prevent duplicate delivery.

Backend ArchitectureInstant MessagingJava
0 likes · 12 min read
How to Build a Reliable, Secure, and Scalable IM Server from Scratch
Programmer DD
Programmer DD
Sep 29, 2019 · Backend Development

Build a Scalable Instant Messaging Server from Scratch – IM1.0.0 Features Explained

This article walks through constructing a lightweight, feature‑rich instant‑messaging backend (IM1.0.0) that supports one‑to‑one text/file messaging, delivery/read receipts, LDAP login, horizontal scaling via connector and transfer modules, user‑status management with Redis, offline storage using MySQL and message queues, and outlines the overall architecture.

Distributed SystemsInstant MessagingMessage Queue
0 likes · 9 min read
Build a Scalable Instant Messaging Server from Scratch – IM1.0.0 Features Explained
58 Tech
58 Tech
Sep 24, 2019 · Operations

Master Election and Load Balancing in WMB Distributed Message Queue

The article explains how WMB, a high‑performance distributed message queue, uses Paxos‑based master election, periodic lease renewal, and a multi‑stage load‑balancing strategy to evenly distribute master nodes across groups, improve throughput, and ensure consistent message delivery.

Master ElectionMessage QueuePaxos
0 likes · 11 min read
Master Election and Load Balancing in WMB Distributed Message Queue
Architecture Digest
Architecture Digest
Aug 14, 2019 · Big Data

Kafka Overview: Architecture, Storage Mechanism, Replication, and Consumer/Producer Model

Kafka is a distributed, partitioned, replicated messaging system originally developed by LinkedIn, offering high throughput, low latency, fault tolerance, and scalability; this article explains its core concepts, file storage design, partition replication, leader election, consumer groups, delivery guarantees, and operational considerations for big‑data pipelines.

Big DataDistributed SystemsKafka
0 likes · 56 min read
Kafka Overview: Architecture, Storage Mechanism, Replication, and Consumer/Producer Model
Qunar Tech Salon
Qunar Tech Salon
Aug 12, 2019 · Backend Development

QMQ: Design, Usage, and Implementation of Qunar's Distributed Message Queue

This article introduces QMQ, Qunar's internal distributed message queue, covering its background, design motivations, core concepts, code examples for producing and consuming both real‑time and delayed messages, transactional messaging support, and the overall architecture of its metaserver, broker, and delay components.

Distributed SystemsJavaMessage Queue
0 likes · 18 min read
QMQ: Design, Usage, and Implementation of Qunar's Distributed Message Queue
Architecture Digest
Architecture Digest
Aug 8, 2019 · Big Data

Kafka Practical Guide: Concepts, Architecture, Configuration, Monitoring, and Management

This article provides a comprehensive overview of Kafka, covering its basic concepts, architecture, deployment, configuration, monitoring, producer and consumer settings, offset management, high availability, replication, leader election, and practical tips for deployment, tuning, and troubleshooting in production environments.

Distributed SystemsKafkaMessage Queue
0 likes · 37 min read
Kafka Practical Guide: Concepts, Architecture, Configuration, Monitoring, and Management
Open Source Tech Hub
Open Source Tech Hub
Aug 5, 2019 · Backend Development

How to Implement a Redis‑Backed Queue in ThinkPHP5

This guide explains how to set up ThinkPHP5's built‑in Queue component with a Redis driver, create a custom queue class, configure the queue, produce messages, and run a consumer process, including handling retries, delays, and daemon mode.

Message QueuePHPThinkPHP5
0 likes · 9 min read
How to Implement a Redis‑Backed Queue in ThinkPHP5
Big Data Technology Architecture
Big Data Technology Architecture
Aug 3, 2019 · Big Data

Kafka Architecture: Design Principles for High Throughput and Reliability

This article explains Kafka's design background, persistence mechanisms, disk sequential I/O optimizations, network and compression strategies, and stability features such as partitioning, replication, and ISR, illustrating how these techniques enable high‑throughput, low‑latency real‑time log processing in big‑data environments.

Disk I/OHigh ThroughputKafka
0 likes · 9 min read
Kafka Architecture: Design Principles for High Throughput and Reliability
NetEase Media Technology Team
NetEase Media Technology Team
Aug 2, 2019 · Backend Development

Delayed Message Queue Implementation: Use Cases, Comparison, and NetEase Open Course Practice

The article explains how delayed message queues replace inefficient scheduled‑task scans in distributed systems, outlines common use cases such as order timeouts and retries, compares RabbitMQ, RocketMQ, Kafka, ActiveMQ and Redis implementations, and details NetEase’s ActiveMQ‑based solution with idempotent processing and traceability.

ActiveMQDistributed SystemsKafka
0 likes · 13 min read
Delayed Message Queue Implementation: Use Cases, Comparison, and NetEase Open Course Practice
FunTester
FunTester
Jul 23, 2019 · Operations

How to Load Test Dubbo Queue APIs with JMeter and Java Concurrency

This article explains a practical approach to performance‑testing Dubbo add and delete methods of a message queue by pre‑generating payloads, using a thread‑safe LinkedBlockingQueue, and driving the calls with JMeter‑compatible Java code.

DubboJMeterJava
0 likes · 6 min read
How to Load Test Dubbo Queue APIs with JMeter and Java Concurrency
FunTester
FunTester
Jul 18, 2019 · Backend Development

Load Testing Dubbo Queue Service Using Java Concurrency and JMeter

This article describes how to conduct load testing of Dubbo queue service methods for adding and deleting messages using Java concurrency utilities and JMeter, including code examples for constructing test data, managing a thread‑safe LinkedBlockingQueue, and handling initialization challenges during repeated test runs.

DubboJavaMessage Queue
0 likes · 5 min read
Load Testing Dubbo Queue Service Using Java Concurrency and JMeter
Big Data Technology & Architecture
Big Data Technology & Architecture
Jul 17, 2019 · Backend Development

Preventing Message Loss in RabbitMQ and Kafka: Principles, Scenarios, and Solutions

This article explains the core principles of message queues, outlines common data‑loss scenarios for RabbitMQ and Kafka, and provides practical techniques—such as transactions, confirm mode, persistence settings, and replication configurations—to ensure reliable, loss‑free messaging.

Backend DevelopmentData ReliabilityKafka
0 likes · 9 min read
Preventing Message Loss in RabbitMQ and Kafka: Principles, Scenarios, and Solutions
Open Source Tech Hub
Open Source Tech Hub
Jul 17, 2019 · Fundamentals

Master AMQP: Key Terms and Concepts Every Developer Should Know

This guide defines and explains essential AMQP terminology—including virtual hosts, queues, exchanges, bindings, routing keys, producers, consumers, connections, and channels—to help developers grasp how message routing and queue management work in modern messaging systems.

AMQPBackend DevelopmentExchange
0 likes · 5 min read
Master AMQP: Key Terms and Concepts Every Developer Should Know
Big Data Technology & Architecture
Big Data Technology & Architecture
Jul 15, 2019 · Backend Development

Why Use Message Queues? Benefits, Drawbacks, and Comparison of Kafka, ActiveMQ, RabbitMQ, and RocketMQ

The article explains why message queues are employed for decoupling, asynchronous processing, and load‑shedding, outlines their advantages and disadvantages, and compares popular MQ products such as Kafka, ActiveMQ, RabbitMQ, and RocketMQ to guide technology selection.

AsynchronousBackend ArchitectureDecoupling
0 likes · 5 min read
Why Use Message Queues? Benefits, Drawbacks, and Comparison of Kafka, ActiveMQ, RabbitMQ, and RocketMQ
Youzan Coder
Youzan Coder
Jul 12, 2019 · Backend Development

How to Build NSQ Multi‑Data‑Center Deployment with Lookup‑Migrate

This article explains the design and implementation of NSQ dual‑ and multi‑data‑center architectures using a lookup‑migrate proxy, covering deployment scenarios, routing strategies, migration phases, JSON response transformations, and practical lessons learned for reliable message publishing and consumption across data centers.

BackendDistributed SystemsMessage Queue
0 likes · 13 min read
How to Build NSQ Multi‑Data‑Center Deployment with Lookup‑Migrate
Big Data Technology Architecture
Big Data Technology Architecture
Jul 12, 2019 · Big Data

Why Kafka Is So Popular: Features, Use Cases, and Architecture Overview

This article explains why Apache Kafka has become a cornerstone of modern big‑data pipelines by detailing its high‑throughput, fault‑tolerant publish‑subscribe architecture, real‑time processing capabilities, extensive language support, scalability mechanisms, and the wide range of use cases adopted by leading enterprises.

Distributed StreamingKafkaMessage Queue
0 likes · 9 min read
Why Kafka Is So Popular: Features, Use Cases, and Architecture Overview
Big Data Technology & Architecture
Big Data Technology & Architecture
Jul 3, 2019 · Backend Development

Deep Dive into Apache RocketMQ: Architecture, Routing, Storage, and High‑Availability Design

This article provides a comprehensive overview of Apache RocketMQ’s core architecture, including topic routing mechanisms, message storage file designs, high‑availability message sending, concurrent pull and consumption processes, HA synchronization, and transaction messaging, while offering practical learning steps and programming techniques for developers.

Backend DevelopmentDistributed SystemsMessage Queue
0 likes · 14 min read
Deep Dive into Apache RocketMQ: Architecture, Routing, Storage, and High‑Availability Design
Big Data Technology & Architecture
Big Data Technology & Architecture
Jul 1, 2019 · Big Data

How to Ensure High Availability of Message Queues (RabbitMQ and Kafka)

This article explains the concept of high availability for message queues, analyzes interview expectations, and details the HA mechanisms of RabbitMQ (including single, normal cluster, and mirrored modes) and Kafka (partition replication and leader election), highlighting their advantages, drawbacks, and practical considerations.

Distributed SystemsKafkaMessage Queue
0 likes · 11 min read
How to Ensure High Availability of Message Queues (RabbitMQ and Kafka)
dbaplus Community
dbaplus Community
Jun 24, 2019 · Operations

Why Did Our Payment System Auto‑Recover? A Deep Dive into Queue Backlog and Transaction Locks

A new employee at an OTA company faced a mysterious outage where thousands of payment‑related messages piled up in the queue, the system auto‑recovered, and a detailed investigation revealed a stuck MySQL transaction caused by missing response timeout settings, leading to lock contention and message backlog.

HttpClientMessage Queueincident analysis
0 likes · 7 min read
Why Did Our Payment System Auto‑Recover? A Deep Dive into Queue Backlog and Transaction Locks
Architect's Tech Stack
Architect's Tech Stack
May 31, 2019 · Big Data

Kafka Architecture Overview: Producers, Consumers, Partitions, Replication, and Transactions

This article provides a comprehensive overview of Apache Kafka's architecture, covering topics such as producer and consumer workflows, partition and replica management, leader election, offset handling, message delivery semantics, transaction support, and file organization, illustrating how Kafka achieves high performance and scalability.

ConsumerDistributed SystemsKafka
0 likes · 18 min read
Kafka Architecture Overview: Producers, Consumers, Partitions, Replication, and Transactions
DataFunTalk
DataFunTalk
May 27, 2019 · Big Data

Practical Applications and Ecosystem Integration of Apache Kafka

This article explores Apache Kafka’s evolution, core messaging and stream processing capabilities, typical use cases, internal storage mechanisms, API choices, and best practices for deploying Kafka on Kubernetes, providing readers with comprehensive guidance to assess suitability and implement effective Kafka solutions.

Apache KafkaKafka APIsKubernetes
0 likes · 16 min read
Practical Applications and Ecosystem Integration of Apache Kafka
Architect's Tech Stack
Architect's Tech Stack
May 21, 2019 · Backend Development

RabbitMQ Overview: Core Concepts, Usage Scenarios, Message Delivery Guarantees, and Common Interview Questions

This article explains what RabbitMQ is, why it is used, typical application scenarios, how to ensure reliable message publishing and consumption, the roles of sender and receiver acknowledgments, routing mechanisms, clustering options, advantages, drawbacks, and provides interview‑style Q&A with a keyword to obtain full answers.

Message QueueMessagingRabbitMQ
0 likes · 4 min read
RabbitMQ Overview: Core Concepts, Usage Scenarios, Message Delivery Guarantees, and Common Interview Questions
58 Tech
58 Tech
Apr 9, 2019 · Backend Development

Optimizing Group Chat Performance in an Instant Messaging Backend

This article analyzes the challenges of scaling group chat in an instant messaging system and presents architectural optimizations—including shared message storage, periodic conversation list updates, offline count handling, and version‑based incremental sync—to reduce write and read amplification while improving overall performance.

Message QueueWrite Amplificationbackend optimization
0 likes · 12 min read
Optimizing Group Chat Performance in an Instant Messaging Backend
Java Captain
Java Captain
Apr 3, 2019 · Backend Development

Understanding Message Queues: Benefits, Use Cases, and Challenges

This article explains what a message queue (MQ) is, why it is needed beyond in‑memory Java queues, and how it enables decoupling, asynchronous processing, peak‑shaving and rate‑limiting, while also discussing high‑availability, data‑loss, and consumer‑side considerations.

DecouplingJavaMessage Queue
0 likes · 11 min read
Understanding Message Queues: Benefits, Use Cases, and Challenges
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Mar 25, 2019 · Backend Development

Designing a Message Queue: Architecture, Protocols, Storage, and Consumption Management

This article explores the fundamental design of a message queue system, covering overall architecture with producers, brokers, and consumers, key design considerations for the broker, communication protocols such as JMS and AMQP, storage options, and strategies for managing consumption relationships and advanced features.

Backend ArchitectureCommunication ProtocolConsumer Management
0 likes · 8 min read
Designing a Message Queue: Architecture, Protocols, Storage, and Consumption Management
Youzan Coder
Youzan Coder
Mar 15, 2019 · Backend Development

How to Build a Youzan‑Custom NSQ Client with Partitioning, Lookup, and Message Tracing

This guide explains how to construct a client library for Youzan's customized NSQ, covering workflow configuration, nsqd discovery via nsqlookupd, connection establishment, message publishing and consumption, ordered consumption, and the implementation of message tracing with concrete command syntax and response handling.

Client LibraryMessage QueueMessage Tracing
0 likes · 15 min read
How to Build a Youzan‑Custom NSQ Client with Partitioning, Lookup, and Message Tracing
System Architect Go
System Architect Go
Mar 2, 2019 · Backend Development

Mastering NSQ: Deep Dive into Architecture, Configurations, and Best Practices

This article provides a comprehensive overview of NSQ, covering its core components, message flow, producer and consumer interactions, key configuration parameters, handling of timeouts, backoff mechanisms, service discovery with nsqlookupd, and practical considerations for scaling and reliability.

Backend ArchitectureConfigurationDistributed Systems
0 likes · 10 min read
Mastering NSQ: Deep Dive into Architecture, Configurations, and Best Practices
Mafengwo Technology
Mafengwo Technology
Feb 21, 2019 · Backend Development

How MaFengWo Scaled Its Custom Travel Platform with Multi‑Order Grabbing and Real‑Time Matching

The article explains how MaFengWo built a custom travel transaction system that uses multi‑order distribution, a grab‑pool message queue, concurrency‑controlled locking, and long‑connection notifications to efficiently match personalized travel requests with multiple suppliers, boosting conversion rates and platform performance.

Concurrency ControlMessage Queuecustom travel
0 likes · 9 min read
How MaFengWo Scaled Its Custom Travel Platform with Multi‑Order Grabbing and Real‑Time Matching
JD Tech
JD Tech
Feb 11, 2019 · Backend Development

Optimizing JD Service Market's Plugin List Service: From Thread Scaling to a Unified Cache Layer

This article presents a comprehensive case study of how JD's Service Market improved the performance of its core "Available Plugin List" service by analyzing self‑optimizations, resolving external resource conflicts, designing a unified caching model, and implementing asynchronous cache construction using binlog and MQ, ultimately achieving a six‑fold traffic surge handling during peak events.

BackendMessage QueueMicroservices
0 likes · 12 min read
Optimizing JD Service Market's Plugin List Service: From Thread Scaling to a Unified Cache Layer
Java Backend Technology
Java Backend Technology
Jan 26, 2019 · Backend Development

Hidden Pitfalls of Adding a Message Queue to Your Architecture

While message queues can decouple services and smooth traffic spikes, they also introduce availability risks, stability problems like message loss or duplication, and distributed consistency challenges that require careful high‑availability design and reliable transaction strategies.

Distributed ConsistencyMQMessage Queue
0 likes · 6 min read
Hidden Pitfalls of Adding a Message Queue to Your Architecture
Didi Tech
Didi Tech
Jan 15, 2019 · Backend Development

DDMQ: Didi's Open‑Source Distributed Message Queue

Didi Mobility has open‑sourced DDMQ, an enterprise‑grade distributed message queue that delivers millisecond‑level latency and millions of messages per second, supports real‑time, delayed and transactional messages via RocketMQ/Kafka and RocksDB, offers multi‑language SDKs, flexible consumption, server‑side filtering, a unified console, and achieves five‑nine availability across Didi’s ride‑hailing, finance and delivery platforms.

DDMQDistributed MessagingMessage Queue
0 likes · 7 min read
DDMQ: Didi's Open‑Source Distributed Message Queue
Programmer DD
Programmer DD
Jan 15, 2019 · Backend Development

Mastering RocketMQ Transactional Messages for Distributed Consistency

This article explains how RocketMQ’s transactional message feature enables distributed transaction final consistency by using half messages, message check‑back, and defined transaction states, and provides complete Java code samples for producers, listeners, and consumer idempotency handling.

Distributed TransactionsJavaMessage Queue
0 likes · 10 min read
Mastering RocketMQ Transactional Messages for Distributed Consistency
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Jan 11, 2019 · Backend Development

RocketMQ Overview: Introduction, Evolution, Architecture, Key Features, and Application Scenarios

This article provides a comprehensive overview of RocketMQ, covering its origins and evolution, core architecture components, message domain model, essential features such as ordered delivery and deduplication, and typical use cases like traffic shaping, asynchronous decoupling, and distributed transaction messaging.

Backend DevelopmentMessage QueueMessaging Middleware
0 likes · 10 min read
RocketMQ Overview: Introduction, Evolution, Architecture, Key Features, and Application Scenarios
JD Retail Technology
JD Retail Technology
Jan 8, 2019 · Backend Development

Performance, Storage, Indexing, and Caching Design of JMQ4 Middleware

The article presents an in‑depth technical overview of JD's self‑developed JMQ middleware, detailing its performance improvements over previous versions, comparing write throughput with Kafka under synchronous and asynchronous scenarios, and explaining JMQ4's storage architecture, dense indexing, high‑performance I/O, and cache management strategies.

JMQMessage Queuecaching
0 likes · 11 min read
Performance, Storage, Indexing, and Caching Design of JMQ4 Middleware
Programmer DD
Programmer DD
Jan 8, 2019 · Backend Development

How to Build a Reliable Message Service for Distributed Transactions

This article explains how to design and implement a reliable message service that ensures atomicity between upstream business transactions and downstream message delivery, using status management, callbacks, and scheduled tasks to achieve eventual consistency in distributed systems.

Distributed TransactionsMessage Queueeventual consistency
0 likes · 9 min read
How to Build a Reliable Message Service for Distributed Transactions
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Dec 27, 2018 · Backend Development

Fundamentals of Message Queues: Producers, Consumers, Brokers, and Messaging Models

This article explains the core concepts, components, design considerations, and common models of message queues—including point‑to‑point and publish/subscribe—while covering ordering, acknowledgment, transaction support, persistence, high availability, and practical selection guidance for high‑concurrency systems.

BackendBrokerConsumer
0 likes · 8 min read
Fundamentals of Message Queues: Producers, Consumers, Brokers, and Messaging Models
Programmer DD
Programmer DD
Dec 16, 2018 · Cloud Native

Implementing Custom Error Handling in Spring Cloud Stream

This tutorial demonstrates how to create a custom error‑handling flow for Spring Cloud Stream by building a simple producer‑consumer example, configuring input/output bindings, using @StreamListener to simulate a failure, and routing the exception to a @ServiceActivator fallback method, while also discussing version‑specific limitations.

JavaMessage QueueServiceActivator
0 likes · 7 min read
Implementing Custom Error Handling in Spring Cloud Stream
dbaplus Community
dbaplus Community
Dec 12, 2018 · Backend Development

How to Choose the Right Message Queue: RabbitMQ vs Kafka

This article examines the role of message‑queue middleware in high‑concurrency IM systems, compares popular open‑source options such as ActiveMQ, RabbitMQ, Kafka, RocketMQ and ZeroMQ, and provides a detailed multi‑dimensional framework—including functionality, performance, reliability, operational management, and ecosystem factors—to help engineers select the most suitable queue for their specific business needs.

KafkaMessage QueueMiddleware Selection
0 likes · 28 min read
How to Choose the Right Message Queue: RabbitMQ vs Kafka
Manbang Technology Team
Manbang Technology Team
Dec 12, 2018 · Big Data

Kafka Overview: Core Concepts, Architecture, Configuration, and Usage in Real-Time Computing

This article provides a comprehensive technical overview of Kafka, covering its core concepts, producer and consumer models, architecture, configuration parameters, replication mechanisms, performance optimizations, operational monitoring, tooling scripts, and related product implementations for real-time data processing.

Big DataKafkaMessage Queue
0 likes · 18 min read
Kafka Overview: Core Concepts, Architecture, Configuration, and Usage in Real-Time Computing
Tencent Cloud Developer
Tencent Cloud Developer
Dec 7, 2018 · Cloud Native

29 Top Tools for Building Microservices on All Levels

The article surveys thirty‑nine essential open‑source tools for constructing microservices—from API management, messaging, and monitoring to Kubernetes orchestration, programming languages, frameworks, and serverless platforms—highlighting how each solution supports communication, scalability, and rapid development across enterprise, government, education, and charitable applications.

API ManagementKubernetesMessage Queue
0 likes · 13 min read
29 Top Tools for Building Microservices on All Levels
dbaplus Community
dbaplus Community
Dec 6, 2018 · Backend Development

Mastering RabbitMQ: Core Concepts, Patterns, and Advanced Features

This article provides a comprehensive guide to RabbitMQ, covering the fundamentals of message middleware, the P2P and Pub/Sub models, a comparison with Kafka and RocketMQ, detailed explanations of exchanges, queues, channels, and advanced features such as mandatory routing, backup exchanges, TTL, dead‑letter queues, delayed queues, priority queues, and RPC implementations for reliable distributed systems.

Dead Letter QueueDistributed SystemsMessage Queue
0 likes · 23 min read
Mastering RabbitMQ: Core Concepts, Patterns, and Advanced Features
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Nov 29, 2018 · Databases

An Overview of Redis: Data Types, Features, Persistence, Clustering, and Use Cases

Redis is an open-source, in‑memory key‑value store written in C that supports multiple data structures, offers high‑performance caching, persistence via RDB and AOF, various clustering solutions such as Codis and native Redis Cluster, and is widely used for caching, ranking, session management, queues, and pub/sub.

In-Memory DatabaseMessage QueuePersistence
0 likes · 7 min read
An Overview of Redis: Data Types, Features, Persistence, Clustering, and Use Cases
Didi Tech
Didi Tech
Nov 20, 2018 · Operations

Didi's Message Queue Architecture, Migration Strategies, and RocketMQ Operational Practices

At Didi, the team replaced a chaotic mix of Kafka, Redis, and other queues with a custom, RocketMQ‑based service, using dual‑write and dual‑read migration, extensive performance testing, custom failover, batch extensions, and operational tweaks to achieve stable high‑throughput, low‑latency messaging at massive scale.

Message QueueOperationsPerformance Testing
0 likes · 17 min read
Didi's Message Queue Architecture, Migration Strategies, and RocketMQ Operational Practices
Architect's Tech Stack
Architect's Tech Stack
Nov 12, 2018 · Backend Development

Designing a High-Concurrency Flash Sale System with Redis Caching and Lua Scripts

This article explains how to build a high‑concurrency flash‑sale (秒杀) system by separating static page traffic with CDN, using read‑write‑split Redis for early request filtering, applying Lua scripts for atomic inventory deduction, and employing Redis as a simple message queue for asynchronous order persistence.

Backend ArchitectureLuaMessage Queue
0 likes · 9 min read
Designing a High-Concurrency Flash Sale System with Redis Caching and Lua Scripts
Java Backend Technology
Java Backend Technology
Nov 12, 2018 · Backend Development

Why Didi Chose RocketMQ: Lessons from Building a Scalable Message Queue Service

This article recounts Didi's journey from a chaotic mix of Kafka, RocketMQ, Redis, and other queues to a unified, high‑performance messaging platform built on Apache RocketMQ, covering the reasons for abandoning Kafka, the architecture evolution, migration strategies, performance benchmarks, and operational enhancements.

Kafka migrationMessage QueueRocketMQ
0 likes · 17 min read
Why Didi Chose RocketMQ: Lessons from Building a Scalable Message Queue Service
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Nov 11, 2018 · Backend Development

Technical Architecture Behind Alibaba's Double 11 Flash Sale

The article analyzes the massive technical challenges of Alibaba's Double 11 flash‑sale event and explains how cloud elasticity, distributed messaging, containerization, real‑time data processing, AI, front‑end optimization, caching, monitoring, and database sharding together enable billions of transactions within minutes.

AlibabaDouble 11Message Queue
0 likes · 9 min read
Technical Architecture Behind Alibaba's Double 11 Flash Sale
Architects' Tech Alliance
Architects' Tech Alliance
Nov 7, 2018 · Backend Development

An Overview of Apache RocketMQ: Origin, Concept Model, Storage, Deployment, and Best Practices

This article introduces Apache RocketMQ by covering its origin, core concepts such as topics, producers and consumers, storage architecture with CommitLog and ConsumeQueue, deployment components like brokers and name servers, and practical best‑practice guidance for handling duplicates, ordering, and message replay.

ApacheBackend DevelopmentDistributed Messaging
0 likes · 8 min read
An Overview of Apache RocketMQ: Origin, Concept Model, Storage, Deployment, and Best Practices
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Sep 23, 2018 · Fundamentals

Comparison of Mainstream Message Queue Products and Their Typical Use Cases

This article examines the core features, performance characteristics, and typical application scenarios of popular message queue middleware such as ZeroMQ, RabbitMQ, ActiveMQ, Redis, Kafka, and others, while also discussing when to adopt a message queue, its benefits like decoupling, eventual consistency, broadcasting, and flow control, and summarizing best‑practice guidelines.

MQ ComparisonMessage Queueasynchronous communication
0 likes · 13 min read
Comparison of Mainstream Message Queue Products and Their Typical Use Cases
Big Data and Microservices
Big Data and Microservices
Sep 20, 2018 · Backend Development

Why Distributed Transactions Matter: Concepts, Scenarios, and Solutions

This article explains the fundamentals of distributed transactions, why they arise in modern micro‑service architectures, outlines the ACID properties, presents typical use cases such as payments and order processing, and compares common implementation approaches like 2PC, message‑based eventual consistency, and TCC.

2PCDistributed TransactionsMessage Queue
0 likes · 12 min read
Why Distributed Transactions Matter: Concepts, Scenarios, and Solutions
21CTO
21CTO
Sep 14, 2018 · Backend Development

How Message Queues Enable Near Real‑Time Incremental Indexing in Search Engines

This article examines the high‑real‑time requirements of incremental data ingestion for search engines, compares three update schemes, and details how adopting a Kafka subscription‑based message‑queue approach dramatically improves latency and flexibility for the Nuomi search framework.

KafkaMessage Queueincremental indexing
0 likes · 8 min read
How Message Queues Enable Near Real‑Time Incremental Indexing in Search Engines
Architecture Digest
Architecture Digest
Sep 10, 2018 · Backend Development

Low‑Latency and High‑Availability Design of RocketMQ for Double‑11 Peak Traffic

This article reviews the evolution of Alibaba's Aliware message engine, analyzes the latency and availability challenges faced during Double‑11, and describes the low‑latency optimizations, capacity‑guarantee strategies, and multi‑replica high‑availability architecture implemented in RocketMQ to sustain trillion‑level message flows.

Distributed SystemsLow latencyMessage Queue
0 likes · 22 min read
Low‑Latency and High‑Availability Design of RocketMQ for Double‑11 Peak Traffic
Architects' Tech Alliance
Architects' Tech Alliance
Aug 19, 2018 · Backend Development

Evolution of System Architecture: From LAMP to Distributed Services and Service Governance

This article outlines the progressive evolution of system architecture—from a single‑server LAMP setup through service and data separation, caching, clustering, read/write splitting, CDN, distributed storage, NoSQL, business decomposition, and finally distributed services with messaging, service frameworks, and governance—highlighting the motivations, characteristics, and challenges at each stage.

Backend DevelopmentMessage QueueSystem Architecture
0 likes · 12 min read
Evolution of System Architecture: From LAMP to Distributed Services and Service Governance
Java High-Performance Architecture
Java High-Performance Architecture
Jul 21, 2018 · Databases

Master Redis Streams: From Simple Adds to Powerful Consumer Groups

This guide walks through Redis 5's stream feature, showing how to set up a Docker Redis instance, add entries, perform range queries, use blocking reads, create and manage consumer groups, handle pending messages, claim ownership, inspect stream metadata, delete entries, and limit stream length for efficient message queue implementations.

BackendMessage QueueStreams
0 likes · 10 min read
Master Redis Streams: From Simple Adds to Powerful Consumer Groups
System Architect Go
System Architect Go
Jul 8, 2018 · Backend Development

Overview of NSQ: Architecture, Components, and Usage

NSQ is a lightweight, high‑performance open‑source message queue written in Go, and this article explains its core components (nsqd, nsqlookupd, nsqadmin, utilities), message flow architecture, configuration details, deployment recommendations, and additional considerations such as persistence, delivery guarantees, and scalability.

Distributed SystemsMessage QueueNSQ
0 likes · 5 min read
Overview of NSQ: Architecture, Components, and Usage
AntTech
AntTech
Jul 3, 2018 · Backend Development

Evolution of Financial‑Grade Message Queues at Ant Financial

The article reviews the ten‑year evolution of Ant Financial's message queue, detailing its core reliability, consistency, availability and performance requirements, the architectural mechanisms built to meet them, the shift to pull‑mode and API‑mode designs, and the recent integration of compute capabilities to create a smart data transmission platform.

Big DataDistributed SystemsMessage Queue
0 likes · 13 min read
Evolution of Financial‑Grade Message Queues at Ant Financial
Java Captain
Java Captain
Jun 29, 2018 · Backend Development

Introduction to Message Queue Middleware and Its Application Scenarios

This article introduces message queue middleware, explains its role in distributed systems for asynchronous processing, system decoupling, traffic shaping, log handling and message communication, and provides concrete e‑commerce and log‑collection examples illustrating how queues improve performance, scalability and reliability.

Backend DevelopmentLog ProcessingMessage Queue
0 likes · 8 min read
Introduction to Message Queue Middleware and Its Application Scenarios
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Jun 18, 2018 · Backend Development

Unlocking High-Performance MQ: Lessons from Alibaba, Tencent, and Ctrip

To support Meituan’s rapid growth, this article examines the design and evolution of several industry-leading message-queue solutions—including Alibaba’s Notify and RocketMQ, Tencent’s Tube and Hippo, and Ctrip’s Herms—highlighting their reliability, scalability, and decoupling features, and extracting key insights for building robust MQ systems.

Message QueueReliabilityScalability
0 likes · 7 min read
Unlocking High-Performance MQ: Lessons from Alibaba, Tencent, and Ctrip
Java Captain
Java Captain
May 30, 2018 · Backend Development

Key Points for Revisiting Message Queue Middleware: Usage, Drawbacks, Selection, High Availability, Idempotency, Reliability, and Ordering

This article reviews essential concepts of message queue middleware, covering why to use it, its drawbacks, selection criteria, high‑availability designs, preventing duplicate consumption, ensuring reliable transmission, and maintaining message order, providing a concise study guide for developers and architects.

BackendIdempotencyMQ
0 likes · 21 min read
Key Points for Revisiting Message Queue Middleware: Usage, Drawbacks, Selection, High Availability, Idempotency, Reliability, and Ordering
Java Captain
Java Captain
Apr 29, 2018 · Backend Development

RabbitMQ Hello World Tutorial Using the Java Client

This article introduces RabbitMQ as a message broker, explains producer‑consumer terminology, and provides a step‑by‑step Java "Hello World" example with full code, compilation, and execution instructions for both sender and receiver programs.

AMQPJavaMessage Queue
0 likes · 9 min read
RabbitMQ Hello World Tutorial Using the Java Client
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Apr 12, 2018 · Backend Development

How Xiaomi Built the Notify Async Messaging System to Scale Its E‑commerce Platform

This article details Xiaomi's evolution from a simple two‑server e‑commerce site to a sophisticated, decoupled architecture with the Notify asynchronous messaging system, explaining design decisions, message splitting, agent proxying, performance upgrades, and lessons for building resilient backend services.

Message QueueMicroservicesSystem Architecture
0 likes · 13 min read
How Xiaomi Built the Notify Async Messaging System to Scale Its E‑commerce Platform
Didi Tech
Didi Tech
Apr 11, 2018 · Backend Development

How to Turn Synchronous RPC into Asynchronous Queues for Reliable Microservices

The article examines the reliability challenges of microservice architectures that rely heavily on synchronous RPC calls, and proposes a comprehensive solution that converts failing RPCs to asynchronous message‑queue workflows, introduces a write‑ahead‑queue for transactional consistency between databases and queues, and outlines offset management to ensure end‑to‑end fault tolerance.

KafkaMessage QueueMicroservices
0 likes · 12 min read
How to Turn Synchronous RPC into Asynchronous Queues for Reliable Microservices
Programmer DD
Programmer DD
Apr 6, 2018 · Backend Development

How to Choose the Right Message Middleware: Kafka vs RabbitMQ Deep Dive

This comprehensive guide compares Kafka and RabbitMQ across functional features, performance, reliability, operational management, and ecosystem support, offering practical criteria and pitfalls to help engineers select the most suitable message middleware for their distributed systems.

Message QueueMiddleware SelectionRabbitMQ
0 likes · 30 min read
How to Choose the Right Message Middleware: Kafka vs RabbitMQ Deep Dive
Architecture Digest
Architecture Digest
Apr 3, 2018 · Backend Development

A Systematic Overview of Message Queue Technical Points

This article provides a comprehensive, high‑level guide to message queue concepts, covering architecture, performance, high availability, scalability, protocols, consumption models, reliability, message types, ecosystem integration, and management tools for modern distributed systems.

MQMessage Queue
0 likes · 10 min read
A Systematic Overview of Message Queue Technical Points
JD Tech
JD Tech
Apr 2, 2018 · Backend Development

Introduction to MQTT and JMQ’s MQTT Support Architecture

This article introduces the MQTT protocol, outlines its key characteristics, explains the challenges it poses for IoT messaging, and details how JMQ addresses these challenges through a layered proxy‑broker architecture, subscription management, quality‑of‑service handling, and real‑world JD deployment.

BrokerIoTJMQ
0 likes · 8 min read
Introduction to MQTT and JMQ’s MQTT Support Architecture
Youzan Coder
Youzan Coder
Mar 30, 2018 · Backend Development

How Extended NSQ Message Formats Enable Load Testing, Isolation, and Filtering

This article explains the design of an extended NSQ message format, illustrates its application in load‑testing, service isolation, and channel‑level filtering scenarios, describes the NSQ migration proxy tool and Spark/Flume connectors, and outlines future enhancements such as flow control and batch subscription.

Extended Message FormatLoad TestingMessage Filtering
0 likes · 13 min read
How Extended NSQ Message Formats Enable Load Testing, Isolation, and Filtering
Programmer DD
Programmer DD
Mar 12, 2018 · Backend Development

How to Choose the Right Message Queue: Practical Insights Beyond the Hype

This article shares a seasoned developer’s perspective on selecting a message‑queue middleware, outlining typical adoption stages, three key evaluation criteria—coder expertise, current and future requirements, and community/ecosystem health—and offering candid advice on avoiding common pitfalls.

Backend ArchitectureKafkaMQ selection
0 likes · 9 min read
How to Choose the Right Message Queue: Practical Insights Beyond the Hype
System Architect Go
System Architect Go
Feb 28, 2018 · Backend Development

RabbitMQ Tutorial: Basic Async/Await Usage and Work Queues

This article explains RabbitMQ's typical workflow, demonstrates basic message publishing and consumption with async/await in Node.js, introduces work queues with persistent messages and prefetch, and discusses key concepts such as default exchanges, queue durability, and acknowledgment modes.

AcknowledgmentMessage QueueNode.js
0 likes · 5 min read
RabbitMQ Tutorial: Basic Async/Await Usage and Work Queues
Programmer DD
Programmer DD
Feb 10, 2018 · Backend Development

How RocketMQ Handles Transactional Messages: From Producer to Broker

This article explains the internal workflow of RocketMQ transactional messages, covering how producers send half messages, how brokers process commit or rollback requests, the storage mechanisms for transaction state, the periodic transaction check logic, and the differences between file‑system and database implementations.

BrokerJavaMessage Queue
0 likes · 22 min read
How RocketMQ Handles Transactional Messages: From Producer to Broker
JD Retail Technology
JD Retail Technology
Feb 5, 2018 · Backend Development

Design and Implementation of Footprint Platform, Mock Server Platform, and Pre‑release Gray Release Solution for Virtual Products

This article presents the challenges of virtual product development and describes three engineering solutions—a Footprint tracking system, a Mock Server platform, and a pre‑release gray‑release strategy—detailing their backgrounds, architectures, implementations, and operational benefits for improving debugging, testing, and deployment efficiency.

BackendMessage QueueMock Server
0 likes · 8 min read
Design and Implementation of Footprint Platform, Mock Server Platform, and Pre‑release Gray Release Solution for Virtual Products
Architect's Tech Stack
Architect's Tech Stack
Feb 3, 2018 · Backend Development

Quick Guide to Installing, Configuring, and Using Apache RocketMQ 4.2

This tutorial provides a step‑by‑step walkthrough for setting up Apache RocketMQ 4.2 on a 64‑bit Linux system, covering environment prerequisites, downloading source, building binaries, starting NameServer and Broker, sending and receiving messages, and shutting down the services.

BrokerInstallationJava
0 likes · 6 min read
Quick Guide to Installing, Configuring, and Using Apache RocketMQ 4.2
Alibaba Cloud Developer
Alibaba Cloud Developer
Jan 19, 2018 · Backend Development

Dynamic MQ Consumer Throttling with Alibaba Cloud ACM

This article explains how to implement various flow‑control strategies—static rate limiting, dynamic resource‑based limits, connection and concurrency controls—and demonstrates a practical, configuration‑center‑driven approach to globally throttle asynchronous MQ consumers using Alibaba Cloud ACM and Java.

Alibaba CloudConfiguration CenterFlow Control
0 likes · 8 min read
Dynamic MQ Consumer Throttling with Alibaba Cloud ACM
AI Cyberspace
AI Cyberspace
Dec 6, 2017 · Operations

Master RabbitMQ: Message Acknowledgment, Prefetch, RPC, vhosts & Plugins

This article explores RabbitMQ’s core features—including message acknowledgment, prefetch count, RPC support, virtual hosts, and its powerful plugin system—explaining how each works, when to enable or disable them, and providing step‑by‑step command‑line examples for configuring users, permissions, and management tools.

ConfigurationMessage QueueOperations
0 likes · 9 min read
Master RabbitMQ: Message Acknowledgment, Prefetch, RPC, vhosts & Plugins
AI Cyberspace
AI Cyberspace
Dec 4, 2017 · Backend Development

Master RabbitMQ: Install, Core Concepts, and How It Powers Distributed Systems

This article introduces RabbitMQ's role in distributed systems, explains the AMQP protocol, provides step‑by‑step Ubuntu installation commands, and details essential objects such as messages, producers, consumers, queues, exchanges, bindings, routing keys, and exchange types.

AMQPBackendDistributed Systems
0 likes · 8 min read
Master RabbitMQ: Install, Core Concepts, and How It Powers Distributed Systems
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Nov 20, 2017 · Backend Development

Synchronous vs Asynchronous Messaging: When to Use Queues and How They Impact Performance

This article explains the fundamental differences between synchronous and asynchronous communication, explores how message queues decouple producers and consumers, and discusses key considerations such as persistence, performance, reliability, and language support for building robust backend systems.

Message QueueReliabilitySynchronous
0 likes · 9 min read
Synchronous vs Asynchronous Messaging: When to Use Queues and How They Impact Performance
Architecture Digest
Architecture Digest
Sep 10, 2017 · Backend Development

Understanding Distributed Transaction Patterns: TCC, Asynchronous Assurance, and Maximum Effort Notification

The article explains common interview questions on distributed systems and compares transaction coordination methods, detailing the two‑phase commit drawbacks and introducing three patterns—TCC, asynchronous assurance, and maximum‑effort notification—along with their advantages, usage scenarios, and practical considerations.

Backend DevelopmentDistributed TransactionsMessage Queue
0 likes · 4 min read
Understanding Distributed Transaction Patterns: TCC, Asynchronous Assurance, and Maximum Effort Notification