Distributed Messaging

Cognitive Technology Team

Apr 8, 2025 · Backend Development

Design and Implementation of RocketMQ NameServer: Core Functions, Architecture, and Optimization Strategies

The article explains RocketMQ NameServer's lightweight, stateless design, its core routing and metadata management functions, AP‑oriented architecture, fault‑tolerant mechanisms, scalability features, and practical optimization techniques for high availability and low operational cost.

Distributed MessagingNameServerRocketMQ

0 likes · 6 min read

Design and Implementation of RocketMQ NameServer: Core Functions, Architecture, and Optimization Strategies

Linux Ops Smart Journey

Feb 27, 2025 · Information Security

Build Military‑Grade Kafka Security in Four Easy Steps

This guide walks you through four progressive stages—basic configuration, SSL encryption, SCRAM authentication, and combined SSL+SASL—showing how to harden Kafka with certificates, keystores, and client settings to achieve financial‑level protection.

ConfigurationDistributed MessagingKafka

0 likes · 9 min read

Build Military‑Grade Kafka Security in Four Easy Steps

Sanyou's Java Diary

Jan 23, 2025 · Backend Development

How RocketMQ Achieves High Performance and Scalability with Queues, Brokers, and mmap

This article explains how RocketMQ tackles synchronous registration bottlenecks, tight coupling, and traffic‑burst risks by introducing an intermediate queue layer, designing a durable high‑availability broker, leveraging page cache and mmap for zero‑copy I/O, and using a nameserver for automatic routing, ultimately delivering a high‑throughput, low‑latency messaging system.

Distributed MessagingHigh PerformanceMessage Queue

0 likes · 27 min read

How RocketMQ Achieves High Performance and Scalability with Queues, Brokers, and mmap

Architecture & Thinking

Dec 18, 2024 · Backend Development

Mastering RocketMQ: Core Concepts of Topics, Queues, and Messaging

This article explains RocketMQ’s fundamental architecture, detailing the definitions, roles, and interactions of topics, message queues, messages, producers, consumers, consumer groups, and subscription relationships, and highlights how these components work together to achieve high performance, availability, and scalability.

Distributed MessagingMessage QueueMessaging Architecture

0 likes · 7 min read

Mastering RocketMQ: Core Concepts of Topics, Queues, and Messaging

360 Tech Engineering

May 10, 2024 · Cloud Native

Practical Experience of Deploying and Optimizing Apache Pulsar on Kubernetes at 360

This article shares the architecture design, cluster deployment, storage selection, multi‑region mode, service discovery, performance tuning, monitoring, alerting, and future plans of a production‑grade Apache Pulsar platform running on Kubernetes, providing valuable insights for engineers adopting Pulsar.

Apache PulsarCloud NativeDistributed Messaging

0 likes · 17 min read

Practical Experience of Deploying and Optimizing Apache Pulsar on Kubernetes at 360

360 Smart Cloud

May 9, 2024 · Cloud Native

Practical Experience of Deploying and Optimizing Apache Pulsar on Kubernetes at 360

This article shares 360's practical experience deploying Apache Pulsar on Kubernetes, covering architecture design, storage choices, multi‑cluster modes, service discovery, performance tuning, monitoring, alerting, and future plans, offering valuable guidance for engineers building cloud‑native messaging platforms.

Apache PulsarCloud NativeDistributed Messaging

0 likes · 19 min read

DataFunTalk

Apr 30, 2024 · Big Data

Vivo's Evolution of Large‑Scale Distributed Messaging Middleware Architecture and Practices

This technical presentation details Vivo's end‑to‑end big‑data architecture, the evolution from Kafka to Pulsar for massive message processing, deployment strategies, high‑availability mechanisms, observability practices, and future plans for cloud‑native, containerized messaging middleware.

Big DataDistributed MessagingHigh Availability

0 likes · 18 min read

Vivo's Evolution of Large‑Scale Distributed Messaging Middleware Architecture and Practices

JD Retail Technology

Nov 1, 2023 · Big Data

Kafka: Usage Scenarios, Core Concepts, Installation, Configuration, and Practical Operations

This article provides a comprehensive guide to Apache Kafka, covering its typical use cases, fundamental terminology, step‑by‑step installation and environment preparation, detailed configuration of brokers and topics, cluster deployment, producer‑consumer commands, and a Java client example for sending messages.

Big DataDistributed MessagingInstallation

0 likes · 21 min read

Kafka: Usage Scenarios, Core Concepts, Installation, Configuration, and Practical Operations

Code Ape Tech Column

Jul 21, 2023 · Backend Development

Implementing Distributed WebSocket Messaging with Redis and Kafka in Spring

This article explains how to enable cross‑node WebSocket communication in a distributed Spring application by publishing messages to a Redis or Kafka topic, tracking user connections, and routing messages to the appropriate server instance, complete with full code examples and configuration details.

Distributed MessagingKafkaSpring

0 likes · 16 min read

Implementing Distributed WebSocket Messaging with Redis and Kafka in Spring

FunTester

May 5, 2023 · Big Data

Kafka Client API Performance Testing with Producer and Consumer Examples

This article introduces Kafka, a high‑performance distributed messaging system, and provides step‑by‑step Java/Groovy examples for configuring a producer and consumer, demonstrating how to benchmark their throughput using the FunQpsConcurrent framework, along with necessary Gradle dependencies and server setup instructions.

ConsumerDistributed MessagingJava

0 likes · 8 min read

Kafka Client API Performance Testing with Producer and Consumer Examples

Tencent Cloud Developer

Nov 24, 2022 · Backend Development

Kafka Stability Best Practices: Prevention, Monitoring, and Fault Resolution

This guide outlines Kafka stability best practices across three phases—pre‑prevention with tuning, producer/consumer guidelines, and cluster configuration; runtime monitoring using white‑box and black‑box metrics and alerts; and fault resolution strategies for backlogs, consumption blocks, and message loss, plus cost control and idempotence techniques.

Distributed MessagingKafkaMessage Queue

0 likes · 29 min read

Kafka Stability Best Practices: Prevention, Monitoring, and Fault Resolution

Mike Chen's Internet Architecture

Oct 27, 2022 · Backend Development

Understanding Kafka: Architecture, Principles, Features, and Use Cases

This article explains Kafka's distributed publish‑subscribe architecture, detailing its core components, underlying mechanisms with Zookeeper coordination, key features such as high throughput and fault tolerance, and common application scenarios like log collection, user activity tracking, and stream processing.

Distributed MessagingKafkaStreaming

0 likes · 5 min read

Understanding Kafka: Architecture, Principles, Features, and Use Cases

IT Architects Alliance

Aug 30, 2022 · Big Data

Understanding Kafka: Architecture, Topics, Partitions, Producers, Consumers, Offsets, Transactions, and Configuration

This article provides a comprehensive overview of Apache Kafka, explaining its distributed message‑queue architecture, the role of topics and partitions, producer and consumer workflows, leader election, offset management, consumer‑group rebalancing, delivery semantics, transaction processing, file organization, and key configuration settings.

Big DataDistributed MessagingKafka

0 likes · 17 min read

Understanding Kafka: Architecture, Topics, Partitions, Producers, Consumers, Offsets, Transactions, and Configuration

Top Architect

Aug 28, 2022 · Big Data

Understanding Kafka Architecture: Topics, Partitions, Producers, Consumers, Offsets, and Transactions

Kafka is a high‑performance distributed message queue that uses topics, partitions, and replicas for scalability, with producers writing messages, consumers reading them via consumer groups, and advanced features such as offset management, delivery semantics, rebalancing, and exactly‑once transactional processing, all coordinated by Zookeeper.

ConsumersDistributed MessagingKafka

0 likes · 17 min read

Architect

Aug 26, 2022 · Big Data

Deep Dive into Kafka Architecture: Topics, Partitions, Replication, Consumers, and Transactions

This article provides a comprehensive overview of Kafka's architecture, covering topics, partitions, replication, producer and consumer workflows, offset management, rebalancing, delivery semantics, exactly‑once guarantees, transaction handling, file organization, and key configuration settings.

Distributed MessagingKafkaReplication

0 likes · 17 min read

Deep Dive into Kafka Architecture: Topics, Partitions, Replication, Consumers, and Transactions

Code Ape Tech Column

Jun 28, 2022 · Backend Development

Implementing Distributed WebSocket Messaging with Spring Cloud Alibaba, Redis, and Kafka

This article explains how to solve cross‑server WebSocket communication in a distributed Java application by using a message queue (Redis or Kafka) to broadcast messages, storing user‑node mappings, and providing complete Spring configuration, code examples, and a demo page for end‑to‑end testing.

Distributed MessagingJavaKafka

0 likes · 18 min read

Implementing Distributed WebSocket Messaging with Spring Cloud Alibaba, Redis, and Kafka

IT Architects Alliance

Mar 14, 2022 · Big Data

Comprehensive Guide to Kafka Architecture, Core Concepts, and Production Deployment

This article provides an in‑depth overview of Kafka, covering why messaging systems are needed, core concepts, cluster architecture, performance optimizations such as sequential disk writes and zero‑copy, hardware sizing, replication, consumer groups, offset management, rebalance strategies, and practical deployment and operational guidelines.

Big DataDistributed MessagingKafka

0 likes · 35 min read

Comprehensive Guide to Kafka Architecture, Core Concepts, and Production Deployment

Tencent Cloud Developer

Jan 11, 2022 · Cloud Native

Apache Pulsar: Architecture, Topics, Producers, Consumers, and Storage

Apache Pulsar is a cloud‑native distributed messaging system that combines stateless brokers, a BookKeeper storage cluster, and ZooKeeper metadata to route messages from producers to consumers across scalable partitioned or non‑partitioned topics, supporting multiple subscription models, producer access modes, routing strategies, batching, acknowledgments, delayed delivery, and deduplication.

Apache PulsarBookKeeperCloud Native

0 likes · 26 min read

Apache Pulsar: Architecture, Topics, Producers, Consumers, and Storage

Tencent Cloud Developer

Dec 24, 2021 · Cloud Native

Deep Dive into Apache Pulsar Message Acknowledgment Mechanism

Apache Pulsar ensures reliable delivery by letting consumers acknowledge messages individually, cumulatively, or within batches, while also supporting negative acknowledgments and sophisticated tracking mechanisms that batch ack requests, use BitSet for batch indexes, and employ time‑wheel‑based redelivery for unacknowledged messages.

Apache PulsarConsumer TrackerDistributed Messaging

0 likes · 10 min read

Deep Dive into Apache Pulsar Message Acknowledgment Mechanism

Java Architect Essentials

Oct 14, 2021 · Backend Development

Analysis of Alipay Android Wallet System Architecture and MetaQ Distributed Messaging Middleware

This article presents a detailed overview of Alipay's Android wallet system architecture, illustrating its core components such as settlement, customer service, fund processing, and accounting, and further examines the open‑source MetaQ (Metamorphosis) distributed messaging middleware, highlighting its features, advantages over Kafka, and suitable application scenarios.

AlipayDistributed MessagingMetaQ

0 likes · 5 min read

Analysis of Alipay Android Wallet System Architecture and MetaQ Distributed Messaging Middleware