BestHub
Sign in
Tag

broker design

0 views collected around this technical thread.

Sanyou's Java Diary
Sanyou's Java Diary
Jan 23, 2025 · Backend Development

How RocketMQ Achieves High Performance and Scalability with Queues, Brokers, and mmap

This article explains how RocketMQ tackles synchronous registration bottlenecks, tight coupling, and traffic‑burst risks by introducing an intermediate queue layer, designing a durable high‑availability broker, leveraging page cache and mmap for zero‑copy I/O, and using a nameserver for automatic routing, ultimately delivering a high‑throughput, low‑latency messaging system.

Distributed MessagingMessage Queueasynchronous processing
0 likes · 27 min read
How RocketMQ Achieves High Performance and Scalability with Queues, Brokers, and mmap
IT Services Circle
IT Services Circle
May 27, 2022 · Backend Development

Design Principles of a High‑Performance Message Broker (RocketMQ)

The article explains how to redesign a high‑traffic user‑registration flow by introducing an asynchronous queue layer, detailing the broker architecture, commitlog, consumeQueue, page‑cache, mmap, topic/tag routing, high‑availability strategies, and the role of a nameserver in a RocketMQ‑style system.

High AvailabilityMMAPMessage Queue
0 likes · 26 min read
Design Principles of a High‑Performance Message Broker (RocketMQ)
macrozheng
macrozheng
May 26, 2022 · Backend Development

How RocketMQ Uses Queues, Page Cache, and mmap to Achieve High Performance and Scalability

This article explains how RocketMQ tackles registration latency, synchronous coupling, and traffic spikes by introducing an intermediate queue, designing a persistent high‑availability broker, leveraging Linux page cache and memory‑mapped files, and employing topics, tags, and sharding to enable efficient asynchronous processing and scalable consumption.

Message Queueasynchronous processingbroker design
0 likes · 28 min read
How RocketMQ Uses Queues, Page Cache, and mmap to Achieve High Performance and Scalability
Sohu Tech Products
Sohu Tech Products
May 25, 2022 · Backend Development

Design Principles of RocketMQ: Broker Architecture, Persistence, High Performance and High Availability

The article explains how RocketMQ tackles growing business traffic by introducing an asynchronous broker layer, using commitlog and consumeQueue files, page‑cache, mmap, topic/tag routing, and a nameserver to achieve high‑throughput, low‑latency, and highly available message delivery.

Message Queuebackend developmentbroker design
0 likes · 30 min read
Design Principles of RocketMQ: Broker Architecture, Persistence, High Performance and High Availability
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Mar 25, 2019 · Backend Development

Designing a Message Queue: Architecture, Protocols, Storage, and Consumption Management

This article explores the fundamental design of a message queue system, covering overall architecture with producers, brokers, and consumers, key design considerations for the broker, communication protocols such as JMS and AMQP, storage options, and strategies for managing consumption relationships and advanced features.

Consumer ManagementMessage QueueStorage Options
0 likes · 8 min read
Designing a Message Queue: Architecture, Protocols, Storage, and Consumption Management