BestHub
Sign in
Tagged articles

Message Queue

1036 articles · Page 11 of 11
dbaplus Community
dbaplus Community
Jun 1, 2016 · Backend Development

Mastering RabbitMQ: Architecture, Optimization, and Real-World Cases in Microservices

This article explores microservice architecture fundamentals, compares synchronous and asynchronous communication, details RabbitMQ’s AMQP model, optimization techniques, high‑availability configurations, flow‑control mechanisms, and shares practical case studies from NetEase’s Hive platform, offering actionable insights for reliable, scalable message‑queue deployments.

High AvailabilityMessage Queuemicroservices
0 likes · 18 min read
Mastering RabbitMQ: Architecture, Optimization, and Real-World Cases in Microservices
Big Data and Microservices
Big Data and Microservices
May 12, 2016 · Industry Insights

How 58 Daojia Built a Scalable Real‑Time Messaging Platform: Architecture Deep Dive

This article dissects the design of 58 Daojia’s universal real‑time messaging platform, detailing the challenges of end‑to‑cloud, cloud‑to‑end, and end‑to‑end communication, the shortcomings of traditional HTTP and push solutions, and the optimized TCP, message‑bus, RPC, and protocol extensions that achieve scalability, reliability, and cross‑account chat.

Backend ArchitectureMessage QueueProtocol Design
0 likes · 12 min read
How 58 Daojia Built a Scalable Real‑Time Messaging Platform: Architecture Deep Dive
Architecture Digest
Architecture Digest
May 3, 2016 · Backend Development

Message Patterns and Their Application in Distributed Enterprise Systems

The article examines various messaging patterns—Message Channel, Publisher‑Subscriber, Message Router, and others—explaining their principles, advantages, and implementation details, and illustrates their use in enterprise distributed architectures through concrete code examples and case studies such as CIMS and a medical system.

Integration PatternsMessage Queuedistributed systems
0 likes · 31 min read
Message Patterns and Their Application in Distributed Enterprise Systems
21CTO
21CTO
Apr 25, 2016 · Backend Development

Scalable Backend Architecture: Load Balancing, Caching, and Platform Layers

Will Larson’s insights on building scalable systems are distilled here, covering horizontal scalability, redundancy, load balancing strategies, various caching techniques, CDN usage, offline processing with message queues, Map‑Reduce for big data, and the benefits of introducing a dedicated platform layer for robust backend architecture.

Backend ArchitectureCachingMessage Queue
0 likes · 11 min read
Scalable Backend Architecture: Load Balancing, Caching, and Platform Layers
21CTO
21CTO
Apr 19, 2016 · Backend Development

How Alibaba’s Notify and MetaQ Power Massive E‑Commerce Messaging

This article explains the design principles, architecture, and performance optimizations of Alibaba's Notify and MetaQ message middleware, illustrating how they achieve reliable asynchronous communication, high scalability, and low latency for billions of messages during peak e‑commerce events like Double 11.

Backend ArchitectureHigh AvailabilityMessage Queue
0 likes · 14 min read
How Alibaba’s Notify and MetaQ Power Massive E‑Commerce Messaging
Big Data and Microservices
Big Data and Microservices
Apr 14, 2016 · Industry Insights

Inside Twitter’s Scalable Architecture: Following, Caching, and Queues Explained

The article breaks down Twitter’s core business of following and being followed, explains its three‑tier presentation‑logic‑data architecture, details cache strategies, message‑queue isolation, and the push‑pull trade‑offs, illustrating how these components work together to achieve high‑performance, fault‑tolerant service at massive scale.

BackendCachingMessage Queue
0 likes · 11 min read
Inside Twitter’s Scalable Architecture: Following, Caching, and Queues Explained
MaGe Linux Operations
MaGe Linux Operations
Mar 28, 2016 · Backend Development

Understanding JMS: Message Models, Consumption, and Popular Middleware

This article explains the JMS standard, its two messaging models (Point‑to‑Point and Publish/Subscribe), how messages are consumed synchronously or asynchronously, the core JMS programming objects, and provides an overview of common middleware such as ActiveMQ, RabbitMQ, ZeroMQ, and Kafka.

ActiveMQKafkaMessage Queue
0 likes · 17 min read
Understanding JMS: Message Models, Consumption, and Popular Middleware
21CTO
21CTO
Mar 24, 2016 · Backend Development

How to Build a Reliable Java Delayed Queue for Scalable Backend Systems

This article explains the design, architecture, and implementation details of a Java-based delayed queue, covering use cases, core components, message lifecycle, protocol, current topology, shortcomings, and future improvements for reliable backend processing.

Backend ArchitectureDelayed QueueMessage Queue
0 likes · 10 min read
How to Build a Reliable Java Delayed Queue for Scalable Backend Systems
21CTO
21CTO
Mar 12, 2016 · Backend Development

Designing Scalable Asynchronous Message Queues: Ctrip’s Hermes Architecture Deep Dive

This article examines Ctrip's Hermes asynchronous messaging system, detailing its evolution from a simple Mongo‑backed queue to a broker‑centric, partitioned architecture with lease‑based cluster management, and shares practical techniques for building high‑performance, low‑latency message queues in large‑scale distributed environments.

Backend ArchitectureHermesMessage Queue
0 likes · 21 min read
Designing Scalable Asynchronous Message Queues: Ctrip’s Hermes Architecture Deep Dive
Architect
Architect
Mar 12, 2016 · Backend Development

Design and Evolution of Ctrip's Hermes Message Queue System

This article presents a detailed overview of Ctrip's Hermes message queue system, covering its architectural evolution from a simple Mongo‑based design to a broker‑centric, multi‑storage solution with meta‑server coordination, and discusses practical techniques for building high‑performance, scalable messaging infrastructure.

Cluster ManagementCtripHermes
0 likes · 21 min read
Design and Evolution of Ctrip's Hermes Message Queue System
Java High-Performance Architecture
Java High-Performance Architecture
Feb 29, 2016 · Backend Development

How Kafka Stores and Retrieves Messages: Inside Partitions, Segments, and Index Files

Kafka persists messages on disk by organizing each topic into multiple partitions, which are further divided into segment files containing paired .index and .log files; this structure enables efficient storage, offset-based lookup, and fast retrieval of specific messages through binary search across segment indexes.

KafkaMessage QueueStorage Architecture
0 likes · 5 min read
How Kafka Stores and Retrieves Messages: Inside Partitions, Segments, and Index Files
21CTO
21CTO
Feb 14, 2016 · Backend Development

Unlocking High‑Performance Systems: How Message Queues Transform Backend Architecture

This article provides a comprehensive overview of message queues, covering their core concepts, key application scenarios such as asynchronous processing, system decoupling, traffic shaping, log handling, and communication, and examines popular middleware like ActiveMQ, RabbitMQ, ZeroMQ, and Kafka, along with JMS models and programming details.

KafkaMessage Queueasynchronous processing
0 likes · 22 min read
Unlocking High‑Performance Systems: How Message Queues Transform Backend Architecture
21CTO
21CTO
Jan 9, 2016 · Backend Development

How Distributed Transactions Keep Money Transfers Consistent Without Locks

This article explains the challenges of ensuring data consistency across multiple databases during operations like Alipay transfers, introduces local and distributed transactions, details the two‑phase commit protocol, and shows how reliable messaging can replace heavyweight distributed transactions for high‑concurrency systems.

Data ConsistencyDistributed TransactionsMessage Queue
0 likes · 10 min read
How Distributed Transactions Keep Money Transfers Consistent Without Locks
Architect
Architect
Jan 9, 2016 · Backend Development

Ensuring Data Consistency: Local Transactions, Distributed Two‑Phase Commit, and Message‑Queue Solutions

The article explains how to maintain data consistency when updating related tables by using local transactions for single‑node databases, distributed two‑phase commit for multi‑node systems, and reliable message‑queue patterns—including deduplication techniques—to avoid the performance pitfalls of traditional distributed transactions.

Data ConsistencyMessage Queuetwo-phase commit
0 likes · 10 min read
Ensuring Data Consistency: Local Transactions, Distributed Two‑Phase Commit, and Message‑Queue Solutions
Java High-Performance Architecture
Java High-Performance Architecture
Dec 23, 2015 · Backend Development

Ensuring Safe Redis Queues with RPOPLPUSH and Blocking Commands

Redis lists enable simple message queues, but using LPOP/RPOP can lose messages if a consumer crashes; employing the atomic RPOPLPUSH (or its blocking BRPOPLPUSH) command safeguards delivery, and choosing blocking over non‑blocking operations reduces wasted polling and improves resource efficiency.

Blocking CommandsMessage QueueRPOPLPUSH
0 likes · 4 min read
Ensuring Safe Redis Queues with RPOPLPUSH and Blocking Commands
dbaplus Community
dbaplus Community
Nov 24, 2015 · Backend Development

Open‑Source vs Commercial Message Queues: Features, Performance & Ops Insights

This article examines the rise of cloud‑native architectures, explains core concepts of Message Oriented Middleware, compares JMS and AMQP protocols, evaluates major commercial and open‑source queue products across functionality, operations management, clustering, high‑availability, stability and extensions, and presents detailed performance test results for point‑to‑point and publish/subscribe modes.

CommercialComparisonMessage Queue
0 likes · 20 min read
Open‑Source vs Commercial Message Queues: Features, Performance & Ops Insights
21CTO
21CTO
Nov 16, 2015 · Cloud Computing

How JD.com Scales Storage, Caching, and Messaging with Its Own Cloud Platform

This article explains how JD.com’s three‑layer cloud architecture—storage, middleware, and elastic compute—addresses challenges of massive unstructured data, ever‑growing caches, high‑volume messaging, and rapid service deployment using home‑grown systems like JFS, Jimdb, JMQ, and JSF.

CachingCloud ComputingElastic Compute
0 likes · 11 min read
How JD.com Scales Storage, Caching, and Messaging with Its Own Cloud Platform
21CTO
21CTO
Nov 13, 2015 · Backend Development

Optimizing Broker Restarts and Minimizing File Reads in EQueue

This article explains how EQueue handles broker restarts by scanning and initializing chunk files, introduces memory‑based caching strategies to avoid frequent file reads, and outlines message deletion, querying, consumer offset storage, and queue management techniques for high‑performance backend systems.

EQueueMemory CachingMessage Queue
0 likes · 22 min read
Optimizing Broker Restarts and Minimizing File Reads in EQueue
21CTO
21CTO
Nov 13, 2015 · Backend Development

How I Reengineered EQueue to Use File-Based Persistence for Faster Messaging

The article details the author's multi‑month effort to replace SQL Server persistence in the open‑source EQueue message queue with a high‑performance local file storage solution, covering the motivations, design considerations, chunked binary file format, write‑and‑read mechanisms, and flushing strategies.

C++EQueueMessage Queue
0 likes · 17 min read
How I Reengineered EQueue to Use File-Based Persistence for Faster Messaging
21CTO
21CTO
Oct 29, 2015 · Backend Development

Scaling Sina's News Comment System: From 3.0 to 5.0 – Key Backend Lessons

This article chronicles the evolution of Sina's news comment platform from a single‑server C++/MySQL prototype to a multi‑node, asynchronous, Python‑based architecture, highlighting the caching, sharding, and queueing techniques that enabled the system to survive massive traffic spikes without downtime.

Backend ArchitectureCachingMessage Queue
0 likes · 21 min read
Scaling Sina's News Comment System: From 3.0 to 5.0 – Key Backend Lessons
21CTO
21CTO
Sep 14, 2015 · Backend Development

Why Apache Kafka Beats Traditional Message Queues: Architecture, Code, and Performance

This article explains Apache Kafka's distributed publish‑subscribe design, core components, storage model, ZooKeeper coordination, performance benchmarks against ActiveMQ and RabbitMQ, and provides Java producer and consumer code examples for building high‑throughput messaging applications.

Apache KafkaDistributed MessagingMessage Queue
0 likes · 16 min read
Why Apache Kafka Beats Traditional Message Queues: Architecture, Code, and Performance
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Sep 14, 2015 · Industry Insights

Why Kafka Dominates Distributed Messaging: Architecture, Features, and Best Practices

This article provides an in‑depth examination of Apache Kafka’s origins, design goals, core concepts such as brokers, topics, partitions, producers and consumers, compares it with other message queues, explains its storage format, configuration options, delivery guarantees, and includes practical Java code examples for partitioning and consumption.

JavaKafkaMessage Queue
0 likes · 22 min read
Why Kafka Dominates Distributed Messaging: Architecture, Features, and Best Practices
21CTO
21CTO
Sep 10, 2015 · Databases

Keeping Money Transfers Consistent: Local Transactions, 2PC, and Message Queues

To prevent data inconsistencies when transferring funds—like moving money from Alipay to Yu'ebao—the article explores local transactions, the limitations of two-phase commit in distributed systems, and how reliable message queues can achieve eventual consistency without sacrificing performance.

Data ConsistencyDistributed TransactionsMessage Queue
0 likes · 11 min read
Keeping Money Transfers Consistent: Local Transactions, 2PC, and Message Queues
21CTO
21CTO
Aug 18, 2015 · Fundamentals

How to Build Horizontally Scalable Systems: Lessons from Will Larson

This article distills Will Larson’s insights on designing scalable systems, covering linear capacity growth, redundancy, load‑balancing strategies, multi‑layer caching, cache invalidation, offline processing with message queues, Map‑Reduce integration, and the benefits of a dedicated platform layer.

CachingMessage Queuehorizontal scaling
0 likes · 11 min read
How to Build Horizontally Scalable Systems: Lessons from Will Larson
21CTO
21CTO
Aug 14, 2015 · Backend Development

Ensuring Data Consistency: From Local Transactions to Distributed 2PC and Message Queues

This article explores how to maintain data consistency across services by using local transactions, two‑phase commit distributed transactions, and reliable message‑queue patterns, illustrating each method with an Alipay‑to‑YuEBao transfer example and discussing their trade‑offs.

Data ConsistencyMessage Queuedistributed systems
0 likes · 11 min read
Ensuring Data Consistency: From Local Transactions to Distributed 2PC and Message Queues
Meituan Technology Team
Meituan Technology Team
Jan 14, 2015 · Big Data

Kafka File Storage Mechanism and Architecture

Kafka stores each topic as partitions that are divided into sequential segment files containing paired .log data and .index files, using global offsets and sparse memory‑mapped indexes to enable fast offset‑based lookups, efficient deletions, and minimal disk I/O in real‑world deployments.

KafkaMessage QueueSegment
0 likes · 9 min read
Kafka File Storage Mechanism and Architecture
ITPUB
ITPUB
Jan 9, 2015 · Databases

Inside Alibaba’s DRDS: How Distributed Databases Power Double‑11

This interview with Alibaba’s DRDS expert Shen Xun reveals how the distributed relational database service evolved from an internal tool to a cloud‑native solution, detailing its architecture, scalability advantages, middleware ecosystem, and real‑world performance during massive events like Double‑11.

Alibaba CloudDRDSMessage Queue
0 likes · 18 min read
Inside Alibaba’s DRDS: How Distributed Databases Power Double‑11
Nightwalker Tech
Nightwalker Tech
Jan 4, 2015 · Backend Development

Design and Pitfalls of Internet App Long‑Connection Push Systems and Related Backend Practices

This article surveys the architecture of long‑connection push systems for internet apps, distinguishes connection types, outlines client and server handling strategies, reviews mainstream backend solutions, and shares practical insights on security, API design, operations, queue services, debugging, and NoSQL usage.

Backend ArchitectureDebuggingMessage Queue
0 likes · 32 min read
Design and Pitfalls of Internet App Long‑Connection Push Systems and Related Backend Practices
MaGe Linux Operations
MaGe Linux Operations
Oct 4, 2014 · Backend Development

Which Notification Mechanism Is Best for High‑Concurrency Message Queues?

This article reviews common notification mechanisms—signal, socket, FIFO, pipe, and eventfd/signalfd—used in high‑performance, lock‑free shared‑memory message queues, comparing their advantages, drawbacks, and suitability for different workload scenarios, and explains why kernel involvement can affect performance and when to prefer each method.

LinuxMessage Queuehigh-concurrency
0 likes · 3 min read
Which Notification Mechanism Is Best for High‑Concurrency Message Queues?