BestHub
Sign in
Tagged articles
48 articles
Page 1 of 1
Architect Chen
Architect Chen
Nov 4, 2025 · Backend Development

Mastering RocketMQ: Architecture, Workflow, and Real‑World Use Cases

This article provides a comprehensive overview of RocketMQ, covering its core components (Producer, Broker, Consumer, NameServer), detailed architecture diagrams, step‑by‑step message production and consumption processes, and typical scenarios such as asynchronous decoupling, traffic shaping, transactional messaging, and event‑driven logging.

Backend ArchitectureBrokerConsumer
0 likes · 6 min read
Mastering RocketMQ: Architecture, Workflow, and Real‑World Use Cases
vivo Internet Technology
vivo Internet Technology
Jul 9, 2025 · Big Data

Why Pulsar Partition Metrics Vanish After Broker Restart? Root Cause & Fix

During a gray‑scale upgrade, a Vivo Pulsar deployment using the KoP protocol experienced a sudden drop in partition consumption rates because the consumer group name vanished from Zookeeper nodes, prompting an in‑depth analysis of the root cause, replication steps, and three progressively refined remediation strategies.

BrokerConsumer MetricsKoP
0 likes · 13 min read
Why Pulsar Partition Metrics Vanish After Broker Restart? Root Cause & Fix
Java Captain
Java Captain
May 23, 2025 · Backend Development

Common Causes of Kafka Message Loss and Mitigation Strategies

This article examines the typical reasons Kafka messages are lost across producers, brokers, and consumers, and provides detailed configuration recommendations and best‑practice solutions to significantly reduce the risk of data loss in distributed streaming systems.

BrokerConfigurationConsumer
0 likes · 15 min read
Common Causes of Kafka Message Loss and Mitigation Strategies
IT Services Circle
IT Services Circle
May 7, 2025 · Backend Development

Understanding RocketMQ Long‑Polling Mechanism and Its Implementation

This article explains how RocketMQ implements long‑polling for message consumption, detailing the pull‑based model, the broker and consumer timeout settings, the internal suspension of pull requests, and the processing loop that resumes suspended requests to improve efficiency.

BackendBrokerConsumer
0 likes · 7 min read
Understanding RocketMQ Long‑Polling Mechanism and Its Implementation
DaTaobao Tech
DaTaobao Tech
Aug 14, 2024 · Backend Development

Deep Dive into RocketMQ Architecture and Core Components

The article thoroughly explains RocketMQ’s architecture—including stateless NameServers for routing, master‑slave Brokers with sequential CommitLog storage, stateless Producers and pull‑or‑push Consumers, message flow, indexing, and synchronous double‑write reliability—showing how these components deliver high‑throughput, scalable, fault‑tolerant messaging for distributed systems.

BrokerConsumerDistributed Systems
0 likes · 20 min read
Deep Dive into RocketMQ Architecture and Core Components
Zhuanzhuan Tech
Zhuanzhuan Tech
Aug 14, 2024 · Operations

IoT Technology Selection and Deployment for an Automated Quality Inspection Center

This article analyzes the challenges of scaling automated quality‑inspection hardware, introduces IoT fundamentals, evaluates application‑layer protocols, MQTT broker options, QoS levels, and compares cloud, local, and edge deployment architectures to recommend a low‑latency, high‑reliability solution for the smart inspection platform.

BrokerDeploymentEdge Computing
0 likes · 22 min read
IoT Technology Selection and Deployment for an Automated Quality Inspection Center
Java High-Performance Architecture
Java High-Performance Architecture
Nov 5, 2022 · Big Data

Why Can Kafka Process 20 Million Messages per Second? Inside Its High‑Performance Architecture

This article explains how Kafka achieves extremely high throughput—up to 20 million messages and 600 MB per second per node—by optimizing the producer, broker, and consumer components through batch sending, custom protocols, page‑cache usage, zero‑copy transfers, and efficient compression algorithms.

BrokerConsumerKafka
0 likes · 7 min read
Why Can Kafka Process 20 Million Messages per Second? Inside Its High‑Performance Architecture
IT Architects Alliance
IT Architects Alliance
Sep 6, 2022 · Operations

How to Guarantee Zero Message Loss with Kafka: Best Practices and Configurations

This article explains why introducing a message queue like Kafka helps decouple systems and control traffic, then dives into the three key questions of detecting, locating, and preventing message loss, offering concrete monitoring methods, configuration settings, and troubleshooting steps for producers, brokers, and consumers.

BrokerConfigurationConsumer
0 likes · 13 min read
How to Guarantee Zero Message Loss with Kafka: Best Practices and Configurations
Wukong Talks Architecture
Wukong Talks Architecture
Sep 2, 2022 · Big Data

Preventing Data Loss in Kafka: Message Semantics, Failure Scenarios, and Reliability Solutions

This article explains Kafka's message delivery semantics, analyzes potential data‑loss scenarios across producer, broker, and consumer components, and provides concrete configuration and coding practices—such as idempotent producers, proper ACK settings, replication factors, and manual offset commits—to maximize message durability and reliability.

BrokerConsumerData loss
0 likes · 18 min read
Preventing Data Loss in Kafka: Message Semantics, Failure Scenarios, and Reliability Solutions
Top Architect
Top Architect
Aug 31, 2022 · Big Data

Kafka Components and Architecture Overview

This article provides a comprehensive overview of Kafka’s core components—including brokers, topics, partitions, producers, and consumers—explaining their roles, relationships, replication, leader/follower dynamics, and architectural diagrams, while also highlighting configuration details and operational considerations for building reliable distributed streaming systems.

BrokerConsumerPartition
0 likes · 9 min read
Kafka Components and Architecture Overview
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Aug 21, 2022 · Backend Development

12 Core Principles of Message Queues (MQ) – A Comprehensive Summary

This article provides a detailed overview of message queue fundamentals, covering producers, consumers, brokers, queue and topic models, delivery guarantees, acknowledgment mechanisms, ordering, persistence, high availability, and selection criteria, helping readers quickly grasp essential MQ concepts for distributed systems.

BrokerConsumerMessage Queue
0 likes · 9 min read
12 Core Principles of Message Queues (MQ) – A Comprehensive Summary
IT Architects Alliance
IT Architects Alliance
Aug 4, 2022 · Big Data

Explanation of Kafka Components and Architecture

This article provides a comprehensive overview of Kafka's core components—including brokers, topics, partitions, producers, and consumers—explaining their roles, how they interact within a Kafka cluster, and illustrating the architecture with diagrams while also noting recent version changes and related disclaimer information.

BrokerConsumerKafka
0 likes · 7 min read
Explanation of Kafka Components and Architecture
Top Architect
Top Architect
Jul 21, 2022 · Big Data

Kafka Components and Architecture Explained

This article provides a comprehensive overview of Kafka's core components—including brokers, topics, partitions, producers, and consumers—explaining their roles, relationships, replication strategies, and how they work together within a Kafka cluster to ensure reliable, scalable message streaming.

BrokerConsumerDistributed
0 likes · 8 min read
Kafka Components and Architecture Explained
Laravel Tech Community
Laravel Tech Community
May 30, 2022 · Backend Development

Highlights of Apache Pulsar 2.10.0 Release: New Features and Bug Fixes

The Apache Pulsar 2.10.0 release introduces automatic cluster failover, lazy‑loading producers, new TableView support, enhanced broker interceptors, enriched client authentication, Etcd metadata storage, and numerous bug fixes, offering developers and operators a more flexible and performant messaging platform.

Apache PulsarBrokerMessaging
0 likes · 7 min read
Highlights of Apache Pulsar 2.10.0 Release: New Features and Bug Fixes
JavaEdge
JavaEdge
Apr 6, 2022 · Big Data

When Does Kafka Lose Data? Proven Strategies to Prevent Message Loss

This article explains Kafka's message delivery semantics, identifies the exact scenarios where data can be lost in producer, broker, and consumer components, and provides concrete configuration and coding practices to ensure reliable, at‑least‑once or exactly‑once delivery in production environments.

BrokerConsumerData Reliability
0 likes · 18 min read
When Does Kafka Lose Data? Proven Strategies to Prevent Message Loss
Java Architecture Diary
Java Architecture Diary
Jan 10, 2022 · Backend Development

Unlock High‑Performance IoT Messaging with mica‑mqtt: A Low‑Latency MQTT Broker

mica‑mqtt, built on t‑io, offers a simple, low‑latency, high‑performance open‑source MQTT component that integrates easily into existing services, supports multiple protocols and deployment scenarios, and includes Spring Boot starter, GraalVM compilation, and Redis‑based clustering for robust IoT solutions.

BackendBrokerJava
0 likes · 6 min read
Unlock High‑Performance IoT Messaging with mica‑mqtt: A Low‑Latency MQTT Broker
High Availability Architecture
High Availability Architecture
Dec 24, 2021 · Backend Development

Understanding Broker‑Side Message Acknowledgment and Cursor Management in Apache Pulsar

This article explains how Apache Pulsar brokers track consumer acknowledgment using cursors, describes persistent and non‑persistent subscription differences, details cursor metadata stored in ZooKeeper and BookKeeper, and outlines optimizations for handling message gaps, including RangeSet improvements and a new LRU‑based storage design.

Apache PulsarBookKeeperBroker
0 likes · 12 min read
Understanding Broker‑Side Message Acknowledgment and Cursor Management in Apache Pulsar
Tencent Cloud Middleware
Tencent Cloud Middleware
Dec 20, 2021 · Backend Development

How Pulsar Brokers Manage Message Acknowledgments and Cursor Gaps

This article explains how Apache Pulsar brokers track consumer acknowledgments using cursors, store metadata in ZooKeeper and BookKeeper, handle acknowledgment gaps with range sets, and optimize memory usage through LRU and segmented storage to ensure reliable message delivery.

Apache PulsarBookKeeperBroker
0 likes · 15 min read
How Pulsar Brokers Manage Message Acknowledgments and Cursor Gaps
Ops Development Stories
Ops Development Stories
Aug 28, 2021 · Operations

Inside Kafka's Topic Deletion: Code Walkthrough & Process Explained

This article explains the complete Kafka topic deletion workflow, from the client’s deleteTopics request through Zookeeper node creation, controller coordination, broker StopReplica handling, log renaming, delayed file removal, and final cleanup, while providing code excerpts and practical Q&A for common pitfalls.

BrokerKafkaScala
0 likes · 17 min read
Inside Kafka's Topic Deletion: Code Walkthrough & Process Explained
Amap Tech
Amap Tech
Jul 16, 2021 · Backend Development

Key Features, Communication Modes, and Internal Implementation of RSocket

RSocket is a binary, back‑pressure‑aware protocol that supports four interaction models—fire‑and‑forget, request‑response, request‑stream, and request‑channel—using multiplexed frames with odd/even stream IDs for true bidirectional communication, and provides a reactive, resumable API suitable for microservices, IoT, and broker‑based architectures.

BackendBrokerReactive Streams
0 likes · 8 min read
Key Features, Communication Modes, and Internal Implementation of RSocket
Cloud Native Technology Community
Cloud Native Technology Community
Jun 9, 2021 · Cloud Native

Understanding Knative Eventing: Broker & Trigger Architecture and Implementation

This article provides a comprehensive overview of Knative Eventing's Broker and Trigger model, detailing background concepts, event routing patterns, data‑plane and control‑plane workflows, and includes practical YAML and command‑line examples for deploying and managing the components in a Kubernetes environment.

BrokerCloud NativeKnative
0 likes · 11 min read
Understanding Knative Eventing: Broker & Trigger Architecture and Implementation
Code Ape Tech Column
Code Ape Tech Column
Feb 26, 2021 · Backend Development

Why Kafka Messages Get Lost and How to Prevent It

This article explains the three places where Kafka can lose messages—Broker, Producer, and Consumer—detailing the underlying mechanisms, the impact of flush and ack settings, and practical configuration and coding strategies to minimize data loss.

Ack SettingsBrokerConfiguration
0 likes · 15 min read
Why Kafka Messages Get Lost and How to Prevent It
Programmer DD
Programmer DD
Dec 17, 2020 · Big Data

Why Kafka Messages Get Lost and How to Prevent It

This article explains the three places where Kafka can lose messages—broker, producer, and consumer—detailing the underlying causes such as page cache flushing, acknowledgment settings, buffer handling, and offset commits, and provides practical configuration and design strategies to minimize data loss and improve reliability.

BrokerConsumerMessage Loss
0 likes · 13 min read
Why Kafka Messages Get Lost and How to Prevent It
Tencent Cloud Developer
Tencent Cloud Developer
Nov 19, 2020 · Backend Development

Kafka Message Queue Reliability Design and Implementation

The article thoroughly explains Kafka’s message‑queue reliability design and implementation, covering use‑case scenarios, core concepts, storage format, producer acknowledgment settings, broker replication mechanisms (ISR, HW, LEO), consumer delivery semantics, the epoch solution for synchronization, and practical configuration guidelines for various consistency and availability requirements.

BrokerConsistencyConsumer
0 likes · 15 min read
Kafka Message Queue Reliability Design and Implementation
Architects Research Society
Architects Research Society
Jul 22, 2020 · Backend Development

Features and Limitations of Various MQTT Brokers

This article documents the supported features, deprecated services, and specific limitations of a range of MQTT brokers, providing a concise reference for developers to understand each broker's capabilities and constraints within IoT and backend messaging systems.

BrokerIoTMQTT
0 likes · 2 min read
Features and Limitations of Various MQTT Brokers
dbaplus Community
dbaplus Community
Jul 15, 2020 · Backend Development

Why RocketMQ Throws TIMEOUT_CLEAN_QUEUE: Deep Dive into Broker Fast-Failure Bug

The article examines a recurring RocketMQ error (TIMEOUT_CLEAN_QUEUE) caused by the broker’s fast‑failure mechanism, explains how the broker queues and thread pools operate, reveals that SYSTEM_BUSY is mistakenly excluded from retry logic—a bug—and proposes both a temporary configuration tweak and a permanent code fix via a PR.

BrokerFast-FailureMessage Queue
0 likes · 8 min read
Why RocketMQ Throws TIMEOUT_CLEAN_QUEUE: Deep Dive into Broker Fast-Failure Bug
Big Data Technology Architecture
Big Data Technology Architecture
Apr 8, 2020 · Backend Development

Key Kafka Broker Configuration Parameters and Tuning Recommendations

This article introduces Kafka as a distributed messaging and stream‑processing platform, then enumerates the most important broker‑side configuration parameters—such as broker.id, log.dirs, zookeeper.connect, listeners, and retention settings—explaining their purpose and providing practical tuning advice for production environments.

BackendBrokerdistributed-systems
0 likes · 7 min read
Key Kafka Broker Configuration Parameters and Tuning Recommendations
Java High-Performance Architecture
Java High-Performance Architecture
Dec 7, 2019 · Backend Development

How Zookeeper Powers Kafka: Key Roles Explained

This article explains how Zookeeper functions as an essential part of Kafka by managing broker status, controller election, quotas, ISR tracking, node and topic registration, as well as consumer offset storage and registration, providing a comprehensive overview for interview preparation.

BrokerConsumerKafka
0 likes · 4 min read
How Zookeeper Powers Kafka: Key Roles Explained
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Dec 27, 2018 · Backend Development

Fundamentals of Message Queues: Producers, Consumers, Brokers, and Messaging Models

This article explains the core concepts, components, design considerations, and common models of message queues—including point‑to‑point and publish/subscribe—while covering ordering, acknowledgment, transaction support, persistence, high availability, and practical selection guidance for high‑concurrency systems.

BackendBrokerConsumer
0 likes · 8 min read
Fundamentals of Message Queues: Producers, Consumers, Brokers, and Messaging Models
JD Tech
JD Tech
Apr 2, 2018 · Backend Development

Introduction to MQTT and JMQ’s MQTT Support Architecture

This article introduces the MQTT protocol, outlines its key characteristics, explains the challenges it poses for IoT messaging, and details how JMQ addresses these challenges through a layered proxy‑broker architecture, subscription management, quality‑of‑service handling, and real‑world JD deployment.

BrokerIoTJMQ
0 likes · 8 min read
Introduction to MQTT and JMQ’s MQTT Support Architecture
Programmer DD
Programmer DD
Feb 10, 2018 · Backend Development

How RocketMQ Handles Transactional Messages: From Producer to Broker

This article explains the internal workflow of RocketMQ transactional messages, covering how producers send half messages, how brokers process commit or rollback requests, the storage mechanisms for transaction state, the periodic transaction check logic, and the differences between file‑system and database implementations.

BrokerJavaMessage Queue
0 likes · 22 min read
How RocketMQ Handles Transactional Messages: From Producer to Broker
Architect's Tech Stack
Architect's Tech Stack
Feb 3, 2018 · Backend Development

Quick Guide to Installing, Configuring, and Using Apache RocketMQ 4.2

This tutorial provides a step‑by‑step walkthrough for setting up Apache RocketMQ 4.2 on a 64‑bit Linux system, covering environment prerequisites, downloading source, building binaries, starting NameServer and Broker, sending and receiving messages, and shutting down the services.

BrokerInstallationJava
0 likes · 6 min read
Quick Guide to Installing, Configuring, and Using Apache RocketMQ 4.2
AI Cyberspace
AI Cyberspace
Nov 27, 2017 · Backend Development

Why Message Queues Are Essential for Scalable Distributed Systems

Message queues act as middleware in distributed systems, enabling decoupling, asynchronous processing, traffic shaping, and reliable communication between producers and consumers, while supporting high concurrency, scalability, and eventual consistency, and come in brokered and broker‑less varieties such as RabbitMQ and ZeroMQ.

BrokerRabbitMQZeroMQ
0 likes · 5 min read
Why Message Queues Are Essential for Scalable Distributed Systems
Architecture Digest
Architecture Digest
Feb 25, 2016 · Backend Development

Ctrip's Hermes Asynchronous Messaging System: Architecture, Evolution, and High‑Performance Practices

The article presents a detailed overview of Ctrip's Hermes asynchronous messaging system, describing its architectural evolution from a simple Mongo‑based queue to a broker‑centric design with MySQL and Kafka back‑ends, and explains optimization techniques for single‑node performance, clustering, lease‑based management, and reliable delivery.

BrokerCtripHermes
0 likes · 22 min read
Ctrip's Hermes Asynchronous Messaging System: Architecture, Evolution, and High‑Performance Practices