BestHub
Sign in
Tagged articles
55 articles
Page 1 of 1
Su San Talks Tech
Su San Talks Tech
May 19, 2026 · Interview Experience

Designing a Hundred‑Billion‑Scale Message Queue: A ByteDance Interview Walkthrough

This article walks through the interview question of designing a message queue that handles billions of messages daily and peaks at millions of QPS, covering traffic calculations, core roles, storage and throughput techniques, scalability, high availability, observability, framework comparisons, a real‑world case study, and key follow‑up interview topics.

High ThroughputKafkaMessage Queue
0 likes · 12 min read
Designing a Hundred‑Billion‑Scale Message Queue: A ByteDance Interview Walkthrough
IT Architects Alliance
IT Architects Alliance
Sep 8, 2025 · Cloud Native

Choosing the Right Message Queue: Kafka vs RabbitMQ vs Pulsar – A Practical Guide

This article examines the core evaluation criteria for enterprise message queues and provides a detailed comparison of Kafka, RabbitMQ, and Pulsar—including performance, reliability, scalability, operational complexity, ecosystem maturity, and business fit—offering actionable guidance for selecting the optimal solution in cloud‑native environments.

KafkaPulsarRabbitMQ
0 likes · 9 min read
Choosing the Right Message Queue: Kafka vs RabbitMQ vs Pulsar – A Practical Guide
vivo Internet Technology
vivo Internet Technology
Aug 13, 2025 · Operations

Mastering Ansible Playbooks for Automated Pulsar Cluster Deployment

This guide walks through Pulsar's operational challenges and demonstrates how to use Ansible Playbooks—including syntax, modules, roles, variables, and task dependencies—to fully automate the deployment of Zookeeper and Pulsar clusters, dramatically reducing manual effort and configuration errors.

AnsibleDevOpsPlaybook
0 likes · 29 min read
Mastering Ansible Playbooks for Automated Pulsar Cluster Deployment
vivo Internet Technology
vivo Internet Technology
Jul 9, 2025 · Big Data

Why Pulsar Partition Metrics Vanish After Broker Restart? Root Cause & Fix

During a gray‑scale upgrade, a Vivo Pulsar deployment using the KoP protocol experienced a sudden drop in partition consumption rates because the consumer group name vanished from Zookeeper nodes, prompting an in‑depth analysis of the root cause, replication steps, and three progressively refined remediation strategies.

BrokerConsumer MetricsKoP
0 likes · 13 min read
Why Pulsar Partition Metrics Vanish After Broker Restart? Root Cause & Fix
Architect
Architect
Jun 6, 2025 · Backend Development

How to Prevent Duplicate Messages in Kafka and Pulsar: A Practical Guide

This article explains the three message delivery semantics, the common causes of duplicate messages in queue systems, and presents concrete producer‑side, broker‑side, and consumer‑side deduplication techniques for Kafka and Pulsar, including code samples and best‑practice recommendations.

BackendIdempotenceKafka
0 likes · 9 min read
How to Prevent Duplicate Messages in Kafka and Pulsar: A Practical Guide
Tencent Cloud Middleware
Tencent Cloud Middleware
Apr 9, 2025 · Operations

How TDMQ Pulsar’s Cluster‑Level and Topic‑Partition Throttling Keeps Your Messaging System Stable

This article explains why high‑throughput producers and consumers can saturate CPU, memory, network and disk I/O in TDMQ Pulsar clusters, describes the built‑in cluster‑level distributed and topic‑partition rate‑limiting mechanisms, and provides practical guidance for configuration, monitoring, and troubleshooting.

Cluster ManagementMessage QueueOperations
0 likes · 12 min read
How TDMQ Pulsar’s Cluster‑Level and Topic‑Partition Throttling Keeps Your Messaging System Stable
Java Tech Enthusiast
Java Tech Enthusiast
Mar 9, 2025 · Backend Development

Handling Duplicate Messages in Message Queues

Message queues can deliver duplicates under at‑least‑once semantics, so to protect idempotent business logic such as orders and payments you should combine producer‑side idempotence (e.g., Kafka’s enable.idempotence), broker‑side deduplication (e.g., Pulsar), and a consumer‑side guard using unique IDs stored in a database or Redis.

IdempotenceKafkaMessage Queue
0 likes · 7 min read
Handling Duplicate Messages in Message Queues
IT Services Circle
IT Services Circle
Mar 8, 2025 · Backend Development

Handling Duplicate Messages in Message Queues: Semantics, Producer and Broker Deduplication, and Consumer Strategies

Message queues can cause duplicate messages that affect idempotent business processes, so this article explains the three delivery semantics (At Least Once, Exactly Once, At Most Once), the causes of duplication, and practical deduplication techniques for producers, brokers (Kafka, Pulsar), and consumers using code examples.

IdempotenceKafkaPulsar
0 likes · 8 min read
Handling Duplicate Messages in Message Queues: Semantics, Producer and Broker Deduplication, and Consumer Strategies
dbaplus Community
dbaplus Community
Feb 26, 2025 · Operations

Choosing the Right Message Queue: A Deep Dive into Kafka, Pulsar, RocketMQ, RabbitMQ, and NSQ

This comprehensive guide explains the role of message queues in distributed systems, compares the architectures and core concepts of Kafka, Pulsar, RocketMQ, RabbitMQ, and NSQ, and provides practical criteria for selecting, configuring, and operating a message‑queue solution in high‑performance, high‑availability environments.

KafkaNSQPulsar
0 likes · 50 min read
Choosing the Right Message Queue: A Deep Dive into Kafka, Pulsar, RocketMQ, RabbitMQ, and NSQ
Sanyou's Java Diary
Sanyou's Java Diary
Sep 19, 2024 · Operations

Message Queue Showdown: Choosing Kafka, Pulsar, RabbitMQ, RocketMQ or NSQ

This comprehensive guide compares five popular message queue systems—Kafka, Pulsar, RabbitMQ, RocketMQ, and NSQ—covering their architectures, core concepts, selection criteria, feature differences such as ordering, latency, durability, scaling, and operational considerations, to help engineers select the most suitable solution for their use cases.

ComparisonKafkaMessage Queue
0 likes · 46 min read
Message Queue Showdown: Choosing Kafka, Pulsar, RabbitMQ, RocketMQ or NSQ
Tencent Cloud Developer
Tencent Cloud Developer
Sep 6, 2024 · Backend Development

Message Queue (MQ) Overview, Selection Criteria, and Comparison of Kafka, Pulsar, RocketMQ, RabbitMQ, and NSQ

The article surveys major message‑queue systems—Kafka, Pulsar, RocketMQ, RabbitMQ, and NSQ—detailing their architectures, key features, selection criteria such as ordering, scalability and latency, performance benchmarks, operational considerations, and typical use cases, and advises which platform best fits high‑throughput, reliability, low‑latency, or lightweight Go‑centric scenarios.

Backend ArchitectureKafkaNSQ
0 likes · 47 min read
Message Queue (MQ) Overview, Selection Criteria, and Comparison of Kafka, Pulsar, RocketMQ, RabbitMQ, and NSQ
Su San Talks Tech
Su San Talks Tech
Aug 3, 2024 · Backend Development

Why Apache Pulsar’s Architecture Beats Traditional Message Queues

This article explains Apache Pulsar’s fast‑growing adoption, its compute‑storage separation architecture, BookKeeper‑based persistence, multi‑tenant support, flexible subscription models, and fault‑tolerant design, providing a comprehensive overview for developers interested in modern distributed messaging middleware.

BookKeeperDistributedMessaging
0 likes · 13 min read
Why Apache Pulsar’s Architecture Beats Traditional Message Queues
Tencent Cloud Developer
Tencent Cloud Developer
Jun 7, 2024 · Cloud Native

Multi-AZ High‑Availability Architecture of Tencent Cloud TDMQ for Apache Pulsar

Tencent Cloud TDMQ for Apache Pulsar achieves multi‑AZ high availability by containerizing ZooKeeper, BookKeeper and Brokers, using managed ZK, persistent cloud disks and elastic NICs, enforcing quorum and rack‑aware replicas, and planning cross‑region bidirectional replication to ensure seamless disaster recovery and continuous messaging.

Cloud NativeMulti‑AZPulsar
0 likes · 15 min read
Multi-AZ High‑Availability Architecture of Tencent Cloud TDMQ for Apache Pulsar
Architect
Architect
May 30, 2024 · Backend Development

Inside Pulsar’s Bookie: A Deep Dive into Storage Architecture and Write/Read Paths

This article dissects Pulsar’s storage layer by examining the Bookie component, detailing its architecture, the sequential write‑ahead log, ledger management, journal handling, caching mechanisms, and the complete read/write call chains with concrete code examples and performance considerations.

Distributed SystemsLedgerPulsar
0 likes · 33 min read
Inside Pulsar’s Bookie: A Deep Dive into Storage Architecture and Write/Read Paths
Sohu Tech Products
Sohu Tech Products
Apr 17, 2024 · Operations

Developing an OpenTelemetry Extension for Pulsar Java Client Metrics

The article walks through building a custom OpenTelemetry Java‑agent extension for Pulsar client metrics—migrating from SkyWalking, setting up a Gradle project, using ByteBuddy to instrument methods with advice, registering gauge metrics, packaging the jar, handling common class‑loader pitfalls, and configuring deployment via the OpenTelemetry operator.

ExtensionInstrumentationJavaAgent
0 likes · 14 min read
Developing an OpenTelemetry Extension for Pulsar Java Client Metrics
Sanyou's Java Diary
Sanyou's Java Diary
Feb 1, 2024 · Backend Development

Message Queues Unveiled: From Decoupling to Platformization and Core Architectures

This article traces the two‑decade evolution of message queues—from early decoupling solutions like ActiveMQ, through high‑throughput designs such as Kafka, to modern platformized systems like RocketMQ and Pulsar—while explaining fundamental concepts, partitioning, and storage architectures that underpin today’s distributed messaging platforms.

Distributed SystemsKafkaMessage Queue
0 likes · 17 min read
Message Queues Unveiled: From Decoupling to Platformization and Core Architectures
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Jan 17, 2024 · Backend Development

Mastering Message Middleware: From Basics to Choosing the Right Solution

This article explains what message middleware is, outlines its key use cases such as asynchronous communication and decoupling, details core principles and models like point‑to‑point and publish/subscribe, reviews popular solutions (Kafka, RabbitMQ, RocketMQ, Pulsar, etc.), and offers selection guidance.

Distributed SystemsKafkaMessage Middleware
0 likes · 8 min read
Mastering Message Middleware: From Basics to Choosing the Right Solution
Wukong Talks Architecture
Wukong Talks Architecture
Oct 13, 2023 · Backend Development

7 Common Message Queue Scenarios and Their Implementations

This article explains seven typical message‑queue use cases—including ordinary, ordered, delayed, transactional, trace, dead‑letter, and priority messages—detailing their business motivations, implementation challenges, and concrete code examples for Kafka, RocketMQ, Pulsar, and RabbitMQ.

Distributed SystemsKafkaMessage Queue
0 likes · 11 min read
7 Common Message Queue Scenarios and Their Implementations
Architect
Architect
Sep 14, 2023 · Backend Development

Message Queue Evolution, Architecture, and Storage Analysis

From the early days of ActiveMQ and RabbitMQ to the high‑throughput designs of Kafka, RocketMQ, and Pulsar, this article traces the development stages of message queues, explains core concepts such as topics, producers, consumers, and partitions, and compares their architectural and storage designs.

BackendPulsarRocketMQ
0 likes · 16 min read
Message Queue Evolution, Architecture, and Storage Analysis
Sohu Tech Products
Sohu Tech Products
Aug 23, 2023 · Operations

Implementing Global Pulsar Client Monitoring with a SkyWalking Plugin

To give the business team a global, application‑level view of Pulsar performance, the team built a SkyWalking Java‑Agent plugin that automatically collects producer and consumer metrics from the Pulsar client, exposing latency, backlog and failure counts via Prometheus without modifying the client code.

MetricsPrometheusPulsar
0 likes · 7 min read
Implementing Global Pulsar Client Monitoring with a SkyWalking Plugin
21CTO
21CTO
Jul 15, 2023 · Backend Development

From ActiveMQ to Pulsar: The Evolution of Message Queues Explained

This article traces the development of message queues from early decoupling solutions like ActiveMQ and RabbitMQ, through high‑throughput designs such as Kafka and RocketMQ, to modern platform‑centric systems like Pulsar, while detailing core concepts, architecture diagrams, storage mechanisms and trade‑offs.

BackendKafkaMessage Queue
0 likes · 15 min read
From ActiveMQ to Pulsar: The Evolution of Message Queues Explained
Tencent Cloud Developer
Tencent Cloud Developer
Jul 12, 2023 · Backend Development

Evolution and Architecture of Message Queues: Kafka, RocketMQ, and Pulsar

The article traces two decades of message‑queue evolution—from early decoupling tools like ActiveMQ, through Kafka’s high‑throughput log model, to Pulsar’s layered, cloud‑native architecture—explaining core concepts, storage designs, and trade‑offs that guide choosing the right MQ for modern workloads.

KafkaPulsarRocketMQ
0 likes · 16 min read
Evolution and Architecture of Message Queues: Kafka, RocketMQ, and Pulsar
Open Source Linux
Open Source Linux
May 6, 2023 · Frontend Development

Top Linux Code Editors That Could Overtake VS Code in 2023

This article reviews four emerging Linux code editors—Pulsar, Atom Community, Lapce, and Lite XL—highlighting their origins, features, performance, and suitability as potential alternatives to Visual Studio Code for developers seeking lightweight or community‑driven tools.

LapceLinuxLite XL
0 likes · 5 min read
Top Linux Code Editors That Could Overtake VS Code in 2023
Tencent Cloud Middleware
Tencent Cloud Middleware
Apr 13, 2023 · Fundamentals

RocketMQ, Kafka, Pulsar: Core Concepts, Architecture & Transactional Messaging

This article provides a comprehensive overview of major message‑queue middleware—including RocketMQ, Kafka, Pulsar, and RabbitMQ—covering fundamental concepts such as tags, groups, offsets, architectural components, storage mechanisms, transaction workflows, rebalance strategies, and recent developments, while comparing their features and performance characteristics.

KafkaMessage QueuePulsar
0 likes · 19 min read
RocketMQ, Kafka, Pulsar: Core Concepts, Architecture & Transactional Messaging
vivo Internet Technology
vivo Internet Technology
Jan 11, 2023 · Cloud Native

Practices of Distributed Message Middleware at vivo: From RocketMQ to Kafka and Pulsar

vivo’s Internet Storage team details how it operates RocketMQ for low‑latency online services and Kafka for massive big‑data pipelines, outlines resource isolation, traffic balancing, intelligent throttling, and governance practices, and describes its migration from RabbitMQ and planned shift from Kafka to cloud‑native Pulsar.

Big DataCloud NativeKafka
0 likes · 22 min read
Practices of Distributed Message Middleware at vivo: From RocketMQ to Kafka and Pulsar
Programmer DD
Programmer DD
Sep 9, 2022 · Big Data

Why Kafka and Pulsar Lead the Distributed Streaming Landscape

This article introduces Apache Kafka and Apache Pulsar, compares their core features such as publish/subscribe messaging, storage, real‑time pipelines, and stream processing, outlines key characteristics like high throughput, scalability and fault tolerance, and explains fundamental concepts and architecture components unique to each platform.

Big DataDistributed StreamingKafka
0 likes · 14 min read
Why Kafka and Pulsar Lead the Distributed Streaming Landscape
Tencent Cloud Developer
Tencent Cloud Developer
Aug 19, 2022 · Backend Development

Message Queue Basics, Use Cases, and Selection Guide for Kafka, RabbitMQ, Pulsar, and RocketMQ

The article explains fundamental concepts, common use cases, and selection criteria for four popular message‑queue platforms—Kafka, RabbitMQ, Pulsar, and RocketMQ—detailing each system’s architecture, strengths, and drawbacks so readers can match workload, scalability, ordering, latency, and operational needs to the most suitable middleware.

Distributed SystemsKafkaMessage Queue
0 likes · 16 min read
Message Queue Basics, Use Cases, and Selection Guide for Kafka, RabbitMQ, Pulsar, and RocketMQ
Top Architect
Top Architect
Jul 31, 2022 · Backend Development

Design and Implementation of Delayed Message Queues in Distributed Systems

This article surveys common delayed‑message solutions in distributed asynchronous messaging, evaluates implementations based on external storage, databases, RocksDB, Redis, and open‑source MQs like RocketMQ, Pulsar and QMQ, and discusses their advantages, drawbacks, and practical design considerations.

Delayed MessagingDistributed SystemsPulsar
0 likes · 13 min read
Design and Implementation of Delayed Message Queues in Distributed Systems
DataFunSummit
DataFunSummit
Jun 2, 2022 · Databases

An In‑Depth Overview of Apache BookKeeper: Architecture, Features, and Use Cases

This article provides a comprehensive technical overview of Apache BookKeeper, covering its role as a distributed append‑only log service, core concepts, high‑availability mechanisms, storage‑media evolution, comparisons with Raft, and community resources, while illustrating its use in Pulsar and large‑scale data platforms.

Apache BookKeeperDistributed LogPulsar
0 likes · 12 min read
An In‑Depth Overview of Apache BookKeeper: Architecture, Features, and Use Cases
Top Architect
Top Architect
May 13, 2022 · Backend Development

Design and Implementation of Delayed Message Queues in Distributed Systems

This article surveys common delayed message implementations—including external storage, RocksDB, Redis, and open‑source MQs like RocketMQ, Pulsar, and QMQ—analyzing their architectures, advantages, drawbacks, and practical considerations for building reliable distributed asynchronous messaging systems.

Distributed SystemsPulsarQMQ
0 likes · 13 min read
Design and Implementation of Delayed Message Queues in Distributed Systems
Code Ape Tech Column
Code Ape Tech Column
Feb 23, 2022 · Backend Development

Design and Implementation of Delayed Message Queues in Distributed Systems

This article examines various delayed‑message implementations in distributed message‑queue systems, comparing external‑storage approaches using databases, RocksDB and Redis, and reviewing built‑in solutions in open‑source MQs such as RocketMQ, Pulsar and QMQ, while discussing their advantages, drawbacks and design considerations.

PulsarRocketMQRocksDB
0 likes · 15 min read
Design and Implementation of Delayed Message Queues in Distributed Systems
Tencent Cloud Developer
Tencent Cloud Developer
Feb 15, 2022 · Backend Development

Message Queue Middleware Selection Guide: Kafka vs Pulsar vs RocketMQ vs RabbitMQ vs NSQ

This guide compares Kafka, Pulsar, RocketMQ, RabbitMQ, and NSQ across architecture, consumption models, delay and dead‑letter support, persistence, ordering, multi‑tenant isolation, and performance, recommending Kafka for high‑throughput log processing, Pulsar for transactional delayed messaging and disaster recovery, and NSQ for Go‑centric custom solutions.

Distributed SystemsKafkaMessage Queue
0 likes · 26 min read
Message Queue Middleware Selection Guide: Kafka vs Pulsar vs RocketMQ vs RabbitMQ vs NSQ
Tencent Cloud Developer
Tencent Cloud Developer
Dec 3, 2021 · Cloud Native

Introducing RoP 0.2.0: Architecture Upgrade and New Features for RocketMQ on Pulsar

The article introduces RoP 0.2.0, a redesign of RocketMQ on Pulsar that eliminates message loss, duplicate consumption, and partial partition consumption, adds ACL authentication, partition expansion for higher throughput, native RocketMQ management APIs, refactors MessageID and routing models, and outlines future features such as tracing, delayed messages, and advanced monitoring.

ACLBrokerMetadataCloudNative
0 likes · 12 min read
Introducing RoP 0.2.0: Architecture Upgrade and New Features for RocketMQ on Pulsar
High Availability Architecture
High Availability Architecture
Oct 28, 2021 · Cloud Native

Design and Implementation Differences between Pulsar, Kafka, RocketMQ, and InLong‑TubeMQ

This article compares Pulsar with Kafka, RocketMQ and InLong‑TubeMQ, focusing on cloud‑native multi‑tenant design, multi‑level flow control, compute‑storage separation, partitioning strategies, metadata storage, and message delivery mechanisms, highlighting each system's architectural advantages and trade‑offs.

Cloud NativeInLong‑TubeMQKafka
0 likes · 18 min read
Design and Implementation Differences between Pulsar, Kafka, RocketMQ, and InLong‑TubeMQ
Tencent Cloud Developer
Tencent Cloud Developer
Oct 26, 2021 · Cloud Native

Design and Implementation Differences between Pulsar, Kafka, RocketMQ, and InLong‑TubeMQ

Pulsar’s cloud‑native, multi‑tenant architecture with hierarchical flow control, stateless brokers separated from BookKeeper storage, global partitions supporting multiple consumers, push‑based dispatch, and precise acknowledgment outperforms Kafka, RocketMQ, and InLong‑TubeMQ, though its reliance on ZooKeeper and higher resource usage demand careful operational planning.

Flow ControlInLong‑TubeMQKafka
0 likes · 17 min read
Design and Implementation Differences between Pulsar, Kafka, RocketMQ, and InLong‑TubeMQ
Tencent Cloud Developer
Tencent Cloud Developer
Sep 14, 2021 · Backend Development

A Comparative Overview of Transactional Messaging in RocketMQ, Kafka, and Pulsar

The article compares how RocketMQ, Apache Kafka, and Apache Pulsar implement transactional messaging—each using a two‑phase commit with half‑messages or transaction buffers, distinct coordinators, and idempotent producers—to provide atomicity and either strong consistency (RocketMQ) or exactly‑once delivery for high‑throughput stream processing (Kafka and Pulsar).

Distributed SystemsExactly-OnceKafka
0 likes · 22 min read
A Comparative Overview of Transactional Messaging in RocketMQ, Kafka, and Pulsar
Alibaba Cloud Developer
Alibaba Cloud Developer
Sep 9, 2021 · Big Data

How Apache Hudi & Pulsar Enable Real‑Time CDC Data Lake Ingestion

This article explains CDC fundamentals, compares query‑based and log‑based capture, describes typical CDC‑to‑lake architectures using Pulsar and Hudi, dives into Hudi's core design, optimization techniques, and future roadmap, and provides practical insights for building scalable data lakes.

Apache HudiCDCPulsar
0 likes · 17 min read
How Apache Hudi & Pulsar Enable Real‑Time CDC Data Lake Ingestion
IT Architects Alliance
IT Architects Alliance
Jun 11, 2021 · Backend Development

Understanding Message Queues: From Redis List to Kafka and Pulsar

This article explains the evolution of message‑queue middleware by comparing the basic double‑ended queue implementation, Redis list usage, Kafka’s partitioned log architecture with segment files and sparse indexes, and Pulsar’s compute‑storage separation using BookKeeper, highlighting their designs, strengths, and trade‑offs.

Distributed SystemsKafkaMessage Queue
0 likes · 28 min read
Understanding Message Queues: From Redis List to Kafka and Pulsar
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Jun 10, 2021 · Backend Development

Why Kafka Beats Redis List: A Deep Dive into Message Queue Architecture

This article compares popular message middleware such as Redis, Kafka, and Pulsar, explaining their underlying data structures, strengths and weaknesses, and how concepts like partitions, replication, cursors, and storage segmentation enable high performance, scalability, and reliability in modern distributed messaging systems.

BackendDistributed SystemsKafka
0 likes · 29 min read
Why Kafka Beats Redis List: A Deep Dive into Message Queue Architecture
Code Ape Tech Column
Code Ape Tech Column
May 10, 2021 · Industry Insights

Why Kafka Beats Redis List: A Deep Dive into Modern Messaging Middleware

This article compares Redis list, Kafka, and Pulsar as messaging middleware, explaining their architectures, strengths, and weaknesses—including queue fundamentals, partitioning, cursor management, consumer groups, high‑availability mechanisms, storage strategies, and consumption models—to help readers choose the right solution for large‑scale systems.

Distributed SystemsKafkaMessaging
0 likes · 30 min read
Why Kafka Beats Redis List: A Deep Dive into Modern Messaging Middleware
Top Architect
Top Architect
May 9, 2021 · Backend Development

Understanding Message Queues: From Redis List to Kafka and Pulsar Architecture

This article explains the evolution of message‑queue middleware by comparing basic double‑ended queue implementations, Redis list usage, Kafka’s partitioned log design with cursor‑based consumption and high‑availability replication, and Pulsar’s compute‑storage separation using BookKeeper, while highlighting their strengths, limitations, and practical trade‑offs.

Distributed SystemsPulsar
0 likes · 30 min read
Understanding Message Queues: From Redis List to Kafka and Pulsar Architecture
Architect
Architect
Apr 27, 2021 · Fundamentals

Understanding Message Queue Architectures: Redis List, Kafka, and Pulsar

This article compares the fundamentals and design trade‑offs of popular message‑queue middleware—Redis list, Kafka, and Pulsar—explaining their data structures, partitioning, persistence, consumer models, high‑availability mechanisms, and scalability challenges for developers and architects.

KafkaPulsarredis
0 likes · 28 min read
Understanding Message Queue Architectures: Redis List, Kafka, and Pulsar
Tencent Cloud Developer
Tencent Cloud Developer
Apr 12, 2021 · Backend Development

Understanding Message Queues: From Basic Queues to Redis, Kafka, and Pulsar

The article compares basic in‑memory queues, Redis lists and streams, Kafka’s partitioned log architecture, and Pulsar’s compute‑storage separation, explaining each system’s core mechanisms, strengths, and limitations so readers can choose the most suitable message‑queue solution for their workloads.

KafkaMessage QueuePulsar
0 likes · 29 min read
Understanding Message Queues: From Basic Queues to Redis, Kafka, and Pulsar
Tencent Cloud Middleware
Tencent Cloud Middleware
Aug 11, 2020 · Cloud Native

How Tencent’s TDMQ Achieves Cloud‑Native, High‑Performance Messaging for Finance

This article explains how Tencent’s cloud‑native message queue TDMQ, built on Apache Pulsar’s storage‑compute separation, meets financial‑grade reliability, strong consistency, horizontal scalability, and cross‑region disaster‑recovery requirements through a quorum‑based consistency model, multi‑protocol support, and read‑only broker design.

Message QueuePulsarcloud-native
0 likes · 28 min read
How Tencent’s TDMQ Achieves Cloud‑Native, High‑Performance Messaging for Finance