BestHub
Sign in
Tagged articles
66 articles
Page 1 of 1
Tencent Cloud Middleware
Tencent Cloud Middleware
Apr 22, 2026 · Backend Development

How TDMQ Pulsar Scales Million-Message Delayed Queues with Multi-Level Time Wheels

The article analyzes why large‑scale delayed messaging is needed, identifies the bottlenecks of the Apache Pulsar community solution, and explains TDMQ Pulsar's three‑step redesign—hierarchical time wheels, expiration re‑push, and immutable message IDs—that together enable stable million‑message delayed queues with controlled memory and minute‑level hole impact.

Apache PulsarDelayed MessagingMessage Queue
0 likes · 8 min read
How TDMQ Pulsar Scales Million-Message Delayed Queues with Multi-Level Time Wheels
ITPUB
ITPUB
Jan 5, 2026 · Backend Development

How Apache Pulsar Solved Our Financial Messaging Challenges

Facing limited visibility, routing, and security in traditional MQ-based financial systems, a company evaluated its needs for identity control, routing, auditing, low latency, scalability, ordering, and replay, and chose Apache Pulsar for its multi‑cluster, compute‑storage separation, pluggable authentication, rich API, and functions, outlining practical experiences and solutions.

Apache PulsarMessagingdistributed architecture
0 likes · 15 min read
How Apache Pulsar Solved Our Financial Messaging Challenges
AI Large Model Application Practice
AI Large Model Application Practice
Sep 4, 2025 · Artificial Intelligence

Can Message Queues Power the Next Generation of AI Agents? A Deep Dive into Pulsar

This article examines how traditional high‑performance message queues and event‑driven architectures can be revitalized for AI agents, tracing the evolution of messaging middleware, highlighting key integration points, and showcasing Apache Pulsar's cloud‑native features that enable reliable, scalable, and intelligent multi‑agent systems.

AI AgentApache PulsarCloud Native
0 likes · 16 min read
Can Message Queues Power the Next Generation of AI Agents? A Deep Dive into Pulsar
360 Zhihui Cloud Developer
360 Zhihui Cloud Developer
Aug 29, 2025 · Backend Development

How Apache Pulsar Achieves Sub‑millisecond Write Latency on NVMe

This article explains Apache Pulsar's architecture, client‑to‑broker and broker‑to‑bookie latency components, data storage model, write path, journal flush strategies, and presents detailed benchmark results showing sub‑millisecond write latency and up to 1.5 million TPS on NVMe storage.

Apache PulsarBackend DevelopmentLatency
0 likes · 10 min read
How Apache Pulsar Achieves Sub‑millisecond Write Latency on NVMe
Wukong Talks Architecture
Wukong Talks Architecture
Aug 21, 2025 · Operations

Why LinkedIn Dropped Kafka for Northguard – A Deep Dive into Its Architecture

LinkedIn, the creator of Kafka, has largely abandoned Kafka in favor of a new log storage system called Northguard, whose design mirrors Apache Pulsar with features like storage‑compute separation, log striping, and a multi‑layer data model, offering superior scalability, operability, consistency, and durability for massive data streams.

Apache PulsarDistributed SystemsLinkedIn
0 likes · 22 min read
Why LinkedIn Dropped Kafka for Northguard – A Deep Dive into Its Architecture
vivo Internet Technology
vivo Internet Technology
Jun 4, 2025 · Cloud Native

Deep Dive into Apache Pulsar Producer: Architecture, Parameters, and Performance Tuning

This article provides a comprehensive analysis of Apache Pulsar's Producer component, detailing its message-sending workflow, key design principles, configuration parameters, and practical performance tuning techniques to improve throughput, reduce latency, and lower resource consumption in large‑scale cloud‑native messaging systems.

Apache PulsarCloud NativeMessaging
0 likes · 26 min read
Deep Dive into Apache Pulsar Producer: Architecture, Parameters, and Performance Tuning
DataFunSummit
DataFunSummit
Jun 3, 2025 · Big Data

BiFang: A Unified Lake‑Stream Storage Engine for Real‑Time and Batch Data Processing

BiFang is a lake‑stream integrated storage engine that merges Apache Pulsar message‑queue capabilities with Iceberg data‑lake features, providing a single unified data store with full‑incremental queries, sub‑second visibility, exactly‑once semantics, and seamless integration with Flink, Spark, and StarRocks for both real‑time analytics and batch processing.

Apache IcebergApache PulsarLakehouse
0 likes · 13 min read
BiFang: A Unified Lake‑Stream Storage Engine for Real‑Time and Batch Data Processing
Xiaohongshu Tech REDtech
Xiaohongshu Tech REDtech
Oct 23, 2024 · Backend Development

Pulsar vs RocketMQ: Architecture, Cost Benefits, and Migration Strategy for Xiaohongshu Online Messaging

Xiaohongshu replaced its RocketMQ‑based online messaging platform with Apache Pulsar, achieving up to 48% total cost reduction, 43% higher CPU utilization, 30% resource savings, and a latency drop from 20.2 ms to 5.7 ms through cloud‑native, elastic scaling and a phased migration strategy.

Apache PulsarCost OptimizationMessage Queue
0 likes · 12 min read
Pulsar vs RocketMQ: Architecture, Cost Benefits, and Migration Strategy for Xiaohongshu Online Messaging
Tencent Cloud Middleware
Tencent Cloud Middleware
Oct 22, 2024 · Operations

Scaling Apache Pulsar on Tencent Cloud: Multi‑Network Access, Cluster Migration & HA Tips

This article details Tencent Cloud engineers' technical solutions for large‑scale Apache Pulsar deployments, covering multi‑network access challenges, a routing‑addressing redesign, product deployment models, a four‑step cluster migration process with subscription‑progress compensation, and high‑availability best practices such as rack‑aware and cross‑AZ replica distribution.

Apache PulsarCluster MigrationMessage Queue
0 likes · 11 min read
Scaling Apache Pulsar on Tencent Cloud: Multi‑Network Access, Cluster Migration & HA Tips
360 Tech Engineering
360 Tech Engineering
May 10, 2024 · Cloud Native

Practical Experience of Deploying and Optimizing Apache Pulsar on Kubernetes at 360

This article shares the architecture design, cluster deployment, storage selection, multi‑region mode, service discovery, performance tuning, monitoring, alerting, and future plans of a production‑grade Apache Pulsar platform running on Kubernetes, providing valuable insights for engineers adopting Pulsar.

Apache PulsarCloud NativeDistributed Messaging
0 likes · 17 min read
Practical Experience of Deploying and Optimizing Apache Pulsar on Kubernetes at 360
360 Smart Cloud
360 Smart Cloud
May 9, 2024 · Cloud Native

Practical Experience of Deploying and Optimizing Apache Pulsar on Kubernetes at 360

This article shares 360's practical experience deploying Apache Pulsar on Kubernetes, covering architecture design, storage choices, multi‑cluster modes, service discovery, performance tuning, monitoring, alerting, and future plans, offering valuable guidance for engineers building cloud‑native messaging platforms.

Apache PulsarCloud NativeDistributed Messaging
0 likes · 19 min read
Practical Experience of Deploying and Optimizing Apache Pulsar on Kubernetes at 360
Didi Tech
Didi Tech
Jan 9, 2024 · Big Data

Introducing Apache Pulsar: Technical Benefits and Solutions for Didi Big Data Messaging System

Apache Pulsar, a cloud‑native distributed messaging platform, solves Didi Big Data’s DKafka bottlenecks by separating compute and storage, using sequential log writes, heterogeneous disks, multi‑level caching, bundle‑based load balancing and automatic scaling, dramatically improving stability while introducing richer monitoring complexity.

Apache PulsarCluster ManagementDKafka
0 likes · 17 min read
Introducing Apache Pulsar: Technical Benefits and Solutions for Didi Big Data Messaging System
360 Smart Cloud
360 Smart Cloud
Sep 13, 2023 · Backend Development

Introduction to Apache Pulsar Architecture and Features

This article introduces Apache Pulsar, an open‑source cloud‑native distributed messaging platform, detailing its storage‑compute separation architecture, multi‑tenant support, load balancing, fault tolerance, schema handling, functions, IO connectors, tiered storage, cross‑region replication, and operational commands for managing brokers, bookies, and namespaces.

Apache PulsarDistributed SystemsMessage Queue
0 likes · 20 min read
Introduction to Apache Pulsar Architecture and Features
Tencent Cloud Middleware
Tencent Cloud Middleware
Jul 21, 2023 · Backend Development

How Pulsar GEO Replication Keeps Subscription State in Sync Across Clusters

This article explains how Apache Pulsar's GEO Replication synchronizes subscription state between primary and backup clusters, detailing the challenges of ledger mismatches, the two‑step mapping process for MessageIds, and the mechanisms that ensure seamless failover without duplicate consumption.

Apache PulsarDistributed MessagingGEO Replication
0 likes · 8 min read
How Pulsar GEO Replication Keeps Subscription State in Sync Across Clusters
Code Ape Tech Column
Code Ape Tech Column
Jul 4, 2023 · Backend Development

Guide to Using Apache Pulsar Java Client with Spring Boot

This tutorial explains how to deploy a single‑node Pulsar cluster with Docker, configure the Java client in a Spring Boot application, and create producers and consumers with detailed code examples and parameter explanations.

Apache PulsarConsumerJava
0 likes · 11 min read
Guide to Using Apache Pulsar Java Client with Spring Boot
Programmer DD
Programmer DD
Jun 7, 2023 · Cloud Native

Why Apache Pulsar Is the Next‑Gen Cloud‑Native Streaming Platform

This article explains how Apache Pulsar combines messaging, storage, and lightweight function computing into a cloud‑native streaming platform, detailing its architecture, storage‑compute separation, tiered storage, pluggable protocols, reliability guarantees, and rich ecosystem compared with traditional queues and Kafka.

Apache PulsarCloud NativeData Reliability
0 likes · 10 min read
Why Apache Pulsar Is the Next‑Gen Cloud‑Native Streaming Platform
WeChat Backend Team
WeChat Backend Team
May 17, 2023 · Big Data

Boosting Real-Time Recommendations: Apache Pulsar Optimizations at WeChat

This article details how WeChat's Gemini‑2.0 big‑data platform leverages Apache Pulsar, outlining cloud‑native advantages, load‑balancing refinements, cache and SSD tuning, high‑availability safeguards, and cost‑saving strategies that together enable large‑scale, real‑time, deep‑learning recommendation workloads.

Apache PulsarBig DataCloud Native
0 likes · 17 min read
Boosting Real-Time Recommendations: Apache Pulsar Optimizations at WeChat
Tencent Cloud Middleware
Tencent Cloud Middleware
Feb 23, 2023 · Cloud Native

How Apache Pulsar Enables Seamless Cross‑Cluster Tenant Migration with Replication and Subscription Sync

This article explains how Apache Pulsar’s cross‑region data replication and subscription‑progress synchronization are implemented and optimized, and how they are combined with the Lookup Service to achieve reliable tenant migration across clusters in a cloud‑native environment.

Apache PulsarCloud NativeCross‑Region Replication
0 likes · 16 min read
How Apache Pulsar Enables Seamless Cross‑Cluster Tenant Migration with Replication and Subscription Sync
Tencent Cloud Middleware
Tencent Cloud Middleware
Feb 15, 2023 · Cloud Native

Tencent Cloud’s Secrets to Scaling Apache Pulsar: Stability & Performance Hacks

This article details Tencent Cloud's year‑long production experience with Apache Pulsar, covering why Pulsar was chosen over Kafka, deep dives into Ack hole handling, TTL/Backlog/Retention strategies, zk‑node and ledger leaks, cache optimizations, and concrete code snippets that illustrate the stability and performance improvements.

Apache PulsarCloud NativeMessage Queue
0 likes · 18 min read
Tencent Cloud’s Secrets to Scaling Apache Pulsar: Stability & Performance Hacks
Tencent Cloud Middleware
Tencent Cloud Middleware
Dec 15, 2022 · Operations

Designing Pulsar Disaster Recovery: Multi‑Region Replication, Rack‑Aware Placement, and Dual‑Write Strategies

This article explains how Tencent engineers configure Apache Pulsar for disaster recovery, covering multi‑replica consistency, journal handling, rack‑aware placement, GEO cross‑region replication, dual‑write/dual‑consume setups, and operational lessons for ad and billing scenarios.

Apache PulsarRack Awarenessmessage queues
0 likes · 10 min read
Designing Pulsar Disaster Recovery: Multi‑Region Replication, Rack‑Aware Placement, and Dual‑Write Strategies
Tencent Cloud Middleware
Tencent Cloud Middleware
Nov 10, 2022 · Cloud Native

How We Scaled Apache Pulsar on Kubernetes for WeChat’s Billion‑User Real‑Time Recommendations

This article details the WeChat engineering team’s practical experience deploying and optimizing Apache Pulsar on Kubernetes for massive real‑time recommendation workloads, covering cloud‑native advantages, non‑persistent topics, load‑balancing tweaks, broker cache improvements, COS offloader development, and future roadmap.

Apache PulsarCloud NativeKubernetes
0 likes · 13 min read
How We Scaled Apache Pulsar on Kubernetes for WeChat’s Billion‑User Real‑Time Recommendations
Tencent Cloud Middleware
Tencent Cloud Middleware
Sep 27, 2022 · Cloud Native

How Tencent Cloud Optimized Apache Pulsar for Million‑Topic Scale

This article details Tencent Cloud's year‑long practical optimizations for Apache Pulsar, covering Ack hole impacts, TTL/Backlog/Retention strategies, delayed‑message handling, Admin API blocking, ZooKeeper and BookKeeper leaks, and multi‑level cache improvements to achieve stable, high‑performance messaging at massive scale.

Apache PulsarBacklogCloud Native
0 likes · 18 min read
How Tencent Cloud Optimized Apache Pulsar for Million‑Topic Scale
vivo Internet Technology
vivo Internet Technology
Sep 14, 2022 · Big Data

Exploring and Practicing Apache Pulsar at vivo: Cluster Management, Monitoring, and Optimization

The vivo big‑data team details how they migrated massive real‑time workloads from Kafka to Apache Pulsar, describing cluster‑level bundle and ledger management, retention policies, a Prometheus‑Kafka‑Druid monitoring pipeline, load‑balancing tweaks, client tuning, rapid broker‑failure recovery, and future cloud‑native tracing and migration plans.

Apache PulsarBig DataCluster Management
0 likes · 19 min read
Exploring and Practicing Apache Pulsar at vivo: Cluster Management, Monitoring, and Optimization
Tencent Cloud Middleware
Tencent Cloud Middleware
Jul 25, 2022 · Operations

How Tencent Scaled Apache Pulsar to Process Billions of Messages Daily – Ops Lessons & Tuning Guide

This article details the design, deployment, and performance‑tuning techniques used by Tencent's TEG Data Platform to operate a massive Apache Pulsar cluster handling trillions of messages per day, covering server‑side parameters, client‑side configurations, common bottlenecks, and step‑by‑step troubleshooting advice.

Apache PulsarGo SDKLarge Scale Messaging
0 likes · 22 min read
How Tencent Scaled Apache Pulsar to Process Billions of Messages Daily – Ops Lessons & Tuning Guide
Laravel Tech Community
Laravel Tech Community
May 30, 2022 · Backend Development

Highlights of Apache Pulsar 2.10.0 Release: New Features and Bug Fixes

The Apache Pulsar 2.10.0 release introduces automatic cluster failover, lazy‑loading producers, new TableView support, enhanced broker interceptors, enriched client authentication, Etcd metadata storage, and numerous bug fixes, offering developers and operators a more flexible and performant messaging platform.

Apache PulsarBrokerMessaging
0 likes · 7 min read
Highlights of Apache Pulsar 2.10.0 Release: New Features and Bug Fixes
DataFunTalk
DataFunTalk
Apr 20, 2022 · Big Data

OpenMLDB Pulsar Connector: A Real‑time Data Integration Guide

This article presents a step‑by‑step tutorial on using the OpenMLDB Pulsar Connector to stream real‑time data from Apache Pulsar into OpenMLDB, covering connector architecture, key features, Docker‑based installation, sink configuration, schema registration, message production, verification queries, and future roadmap details.

Apache PulsarConnectorData Integration
0 likes · 13 min read
OpenMLDB Pulsar Connector: A Real‑time Data Integration Guide
JD Retail Technology
JD Retail Technology
Apr 13, 2022 · Industry Insights

What Drives Sustainable Open‑Source Success? Insights from JD’s Tech Salon

On April 8 2022, JDTECH and JD Retail’s Platform Business R&D co‑hosted a hybrid technical salon on open‑source construction and sustainable development, featuring internal and external experts who shared practical experiences, architectural designs, compliance guidelines, and strategies for building lasting open‑source ecosystems within the company.

Apache PulsarDubboShenYu
0 likes · 7 min read
What Drives Sustainable Open‑Source Success? Insights from JD’s Tech Salon
Tencent Cloud Developer
Tencent Cloud Developer
Jan 11, 2022 · Cloud Native

Apache Pulsar: Architecture, Topics, Producers, Consumers, and Storage

Apache Pulsar is a cloud‑native distributed messaging system that combines stateless brokers, a BookKeeper storage cluster, and ZooKeeper metadata to route messages from producers to consumers across scalable partitioned or non‑partitioned topics, supporting multiple subscription models, producer access modes, routing strategies, batching, acknowledgments, delayed delivery, and deduplication.

Apache PulsarBookKeeperCloud Native
0 likes · 26 min read
Apache Pulsar: Architecture, Topics, Producers, Consumers, and Storage
Tencent Cloud Developer
Tencent Cloud Developer
Dec 24, 2021 · Cloud Native

Deep Dive into Apache Pulsar Message Acknowledgment Mechanism

Apache Pulsar ensures reliable delivery by letting consumers acknowledge messages individually, cumulatively, or within batches, while also supporting negative acknowledgments and sophisticated tracking mechanisms that batch ack requests, use BitSet for batch indexes, and employ time‑wheel‑based redelivery for unacknowledged messages.

Apache PulsarConsumer TrackerDistributed Messaging
0 likes · 10 min read
Deep Dive into Apache Pulsar Message Acknowledgment Mechanism
High Availability Architecture
High Availability Architecture
Dec 24, 2021 · Backend Development

Understanding Broker‑Side Message Acknowledgment and Cursor Management in Apache Pulsar

This article explains how Apache Pulsar brokers track consumer acknowledgment using cursors, describes persistent and non‑persistent subscription differences, details cursor metadata stored in ZooKeeper and BookKeeper, and outlines optimizations for handling message gaps, including RangeSet improvements and a new LRU‑based storage design.

Apache PulsarBookKeeperBroker
0 likes · 12 min read
Understanding Broker‑Side Message Acknowledgment and Cursor Management in Apache Pulsar
Tencent Cloud Middleware
Tencent Cloud Middleware
Dec 20, 2021 · Backend Development

How Pulsar Brokers Manage Message Acknowledgments and Cursor Gaps

This article explains how Apache Pulsar brokers track consumer acknowledgments using cursors, store metadata in ZooKeeper and BookKeeper, handle acknowledgment gaps with range sets, and optimize memory usage through LRU and segmented storage to ensure reliable message delivery.

Apache PulsarBookKeeperBroker
0 likes · 15 min read
How Pulsar Brokers Manage Message Acknowledgments and Cursor Gaps
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Aug 3, 2021 · Big Data

How BIGO Scaled Real‑Time Messaging by Migrating from Kafka to Pulsar

BIGO replaced its Kafka‑based message‑flow platform with Apache Pulsar to overcome scaling, stability, and operational cost challenges, leveraging Pulsar’s storage‑compute separation, seamless horizontal expansion, low latency, and tight integration with Flink for real‑time ETL and AB‑test pipelines, resulting in billions of messages processed daily with half the hardware cost.

Apache PulsarETLFlink
0 likes · 17 min read
How BIGO Scaled Real‑Time Messaging by Migrating from Kafka to Pulsar
Big Data Technology & Architecture
Big Data Technology & Architecture
Jul 27, 2021 · Big Data

An Introduction to Apache Pulsar: Core Concepts, Architecture, and Key Features

Apache Pulsar is a cloud‑native distributed messaging platform that combines messaging, storage, and lightweight compute, featuring multi‑tenant support, geo‑replication, and high throughput, and this article introduces its core concepts, architecture components such as brokers, BookKeeper, ZooKeeper, and key design features.

Apache PulsarBookKeeperCloud Native
0 likes · 13 min read
An Introduction to Apache Pulsar: Core Concepts, Architecture, and Key Features
Tencent Cloud Developer
Tencent Cloud Developer
Jul 13, 2021 · Backend Development

Function Mesh: Serverless Innovation in Message and Streaming Data Scenarios

The talk by Zha Jia showcases StreamNative’s open‑source Function Mesh, which builds on Apache Pulsar’s unified messaging and streaming platform and its lightweight Pulsar Functions, using Kubernetes CRDs to simplify deployment, management, and scaling of serverless data processing while highlighting the project’s rapid community growth.

Apache PulsarBackend DevelopmentCloud Native
0 likes · 18 min read
Function Mesh: Serverless Innovation in Message and Streaming Data Scenarios
Tencent Cloud Middleware
Tencent Cloud Middleware
Jul 8, 2021 · Backend Development

Mastering Pulsar Schema: When and How to Use Schemas for Reliable Messaging

This article explains why Apache Pulsar schemas are essential for serializing POJO data, compares producer usage with and without schemas, details primitive and complex schema types, key/value handling, auto‑schema options, versioning, evolution, compatibility strategies, and provides concrete Java code examples for each scenario.

Apache PulsarBackend DevelopmentJava
0 likes · 14 min read
Mastering Pulsar Schema: When and How to Use Schemas for Reliable Messaging
Tencent Cloud Middleware
Tencent Cloud Middleware
Jun 30, 2021 · Fundamentals

Understanding Apache Pulsar Transactions: Core Concepts and Workflow

Apache Pulsar 2.8.0 introduces transaction support, featuring a Transaction Coordinator, Transaction Buffer, Transaction Log, Transaction ID, and Pending Acknowledge State, with a detailed workflow that ensures exactly‑once semantics for stream processing, contrasting its design with Kafka’s approach.

Apache PulsarExactly-OnceKafka Comparison
0 likes · 13 min read
Understanding Apache Pulsar Transactions: Core Concepts and Workflow
Full-Stack Internet Architecture
Full-Stack Internet Architecture
Jun 18, 2021 · Backend Development

Introducing Apache Pulsar and Its Integration with Spring Boot

This article introduces Apache Pulsar, outlines its key features and advantages over other messaging systems, and provides step‑by‑step Spring Boot integration code examples including dependencies, configuration, producer and consumer implementations for both normal and delayed messages.

Apache PulsarJavaMessage Queue
0 likes · 8 min read
Introducing Apache Pulsar and Its Integration with Spring Boot
macrozheng
macrozheng
Jun 8, 2021 · Backend Development

Master Apache Pulsar with Docker and Spring Boot: A Hands‑On Guide

This article provides a step‑by‑step tutorial on installing Apache Pulsar with Docker, managing it via Pulsar Manager, and integrating it into a Spring Boot application using the Pulsar Java Spring Boot starter, complete with code examples and UI screenshots.

Apache PulsarDockerJava
0 likes · 9 min read
Master Apache Pulsar with Docker and Spring Boot: A Hands‑On Guide
DataFunTalk
DataFunTalk
Jun 6, 2021 · Big Data

Understanding Apache Pulsar: Cloud‑Native Messaging, Storage‑Compute Separation, and Batch‑Stream Fusion with Flink

This article explains Apache Pulsar’s cloud‑native, storage‑compute separated architecture, its data model and scalability features, and how it integrates with Flink to provide a unified platform for both real‑time streaming and batch processing in big‑data applications.

Apache PulsarBatch-Stream IntegrationBig Data
0 likes · 17 min read
Understanding Apache Pulsar: Cloud‑Native Messaging, Storage‑Compute Separation, and Batch‑Stream Fusion with Flink
Big Data Technology & Architecture
Big Data Technology & Architecture
Jun 3, 2021 · Big Data

Comparing Apache Pulsar and Apache Kafka: Architecture, Performance, Use Cases, and Ecosystem

This article compares Apache Pulsar and Apache Kafka across performance, architecture, features, and real‑world use cases, highlighting Pulsar’s multi‑layer design, scalability, client language support, ecosystem integrations, and operational advantages while providing detailed analysis of storage, messaging models, and community resources.

Apache PulsarCloud NativeMessage Queue
0 likes · 28 min read
Comparing Apache Pulsar and Apache Kafka: Architecture, Performance, Use Cases, and Ecosystem
ITFLY8 Architecture Home
ITFLY8 Architecture Home
May 31, 2021 · Backend Development

Why Apache Pulsar Beats Kafka and RocketMQ for Scalable Messaging Platforms

This article details how Lakala built a distributed, cloud‑native messaging platform using Apache Pulsar, covering functional requirements, architectural advantages, performance testing, and real‑world integration scenarios such as OGG adapters, TiDB pipelines, OpenMessaging, custom sources, functions, Flink connectors, and future plans.

Apache PulsarBackend ArchitectureDistributed Messaging
0 likes · 18 min read
Why Apache Pulsar Beats Kafka and RocketMQ for Scalable Messaging Platforms
Tencent Cloud Middleware
Tencent Cloud Middleware
Apr 21, 2021 · Backend Development

How Pulsar Stores Messages and How BookKeeper’s GC Keeps Them Clean

This article explains Apache Pulsar’s message storage architecture in BookKeeper, details the ledger and entry lifecycle, describes the multi‑layer caching read path, and outlines BookKeeper’s garbage‑collection process along with practical operational tips for avoiding disk‑heavy scenarios.

Apache PulsarBackendBookKeeper
0 likes · 12 min read
How Pulsar Stores Messages and How BookKeeper’s GC Keeps Them Clean
Tencent Cloud Developer
Tencent Cloud Developer
Apr 14, 2021 · Cloud Native

Apache Pulsar Meetup Shenzhen: Cloud-Native Distributed Messaging and Streaming Platform

The Apache Pulsar Meetup in Shenzhen on April 17, 2021, co‑hosted by Tencent Middleware and StreamNative, will showcase Pulsar’s cloud‑native messaging, streaming, and storage capabilities through sessions on KoP migration, big‑data and IoT use cases, cloud‑native deployments, and the StreamNative Cloud Pulsar‑as‑a‑Service offering.

Apache PulsarDistributed SystemsMeetup
0 likes · 7 min read
Apache Pulsar Meetup Shenzhen: Cloud-Native Distributed Messaging and Streaming Platform
Tencent Cloud Middleware
Tencent Cloud Middleware
Mar 29, 2021 · Cloud Native

Mastering Apache Pulsar Geo‑Replication: Modes, Configs, and Common Pitfalls

Apache Pulsar’s built‑in Geo‑Replication lets multiple clusters across different regions synchronize data, offering both synchronous and asynchronous modes; this guide explains the three asynchronous patterns—full‑mesh, unidirectional, and failover—detailing required configurations, operational principles, and current limitations.

Apache PulsarCloud NativeCluster Configuration
0 likes · 10 min read
Mastering Apache Pulsar Geo‑Replication: Modes, Configs, and Common Pitfalls
Tencent Cloud Middleware
Tencent Cloud Middleware
Mar 19, 2021 · Fundamentals

How Apache Pulsar Stores, Acknowledges, and Retains Messages

This article explains Apache Pulsar’s core architecture—including its message model, producer and consumer behavior, subscription types, storage hierarchy, acknowledgment mechanisms, cursor handling, backlog concepts, retention policies, and storage size calculations—helping readers understand why storage size can exceed backlog size.

AcknowledgmentApache PulsarBacklog
0 likes · 14 min read
How Apache Pulsar Stores, Acknowledges, and Retains Messages
Laravel Tech Community
Laravel Tech Community
Nov 19, 2020 · Backend Development

Apache Pulsar Go Client 0.3.0 Release Highlights

The Apache Pulsar Go client, a Go‑language SDK for the cloud‑native distributed messaging platform, has been updated to version 0.3.0, adding Key Shared support, schema capabilities for producers and consumers, and configurable reconnection retry attempts.

Apache PulsarBackendCloud Native
0 likes · 2 min read
Apache Pulsar Go Client 0.3.0 Release Highlights
Java High-Performance Architecture
Java High-Performance Architecture
Nov 18, 2020 · Big Data

Why Pulsar Might Outperform Kafka: Key Advantages and Drawbacks

This article examines Apache Pulsar, an open‑source messaging platform created by Yahoo, compares it with Kafka by outlining Kafka’s common pain points, highlights Pulsar’s multi‑tenant architecture, layered storage, built‑in functions, and security features, and discusses the trade‑offs of each solution.

Apache PulsarBig DataDistributed Systems
0 likes · 6 min read
Why Pulsar Might Outperform Kafka: Key Advantages and Drawbacks
Tencent Cloud Middleware
Tencent Cloud Middleware
Aug 17, 2020 · Cloud Native

How Apache Pulsar’s Multi‑Replica I/O Modes Enable Layered Storage

This article explains how Apache Pulsar’s layered architecture separates I/O modes, uses BookKeeper for durable storage, and leverages multi‑replica write quorums and hierarchical caches to provide efficient tail‑read, catch‑up read, and long‑term storage options such as S3, Azure and GCS.

Apache PulsarBookKeeperCloud Native
0 likes · 8 min read
How Apache Pulsar’s Multi‑Replica I/O Modes Enable Layered Storage
Tencent Cloud Developer
Tencent Cloud Developer
Aug 11, 2020 · Cloud Native

Tencent TDMQ: Cloud‑Native Message Queue Architecture and Implementation

Tencent’s TDMQ is a cloud‑native, Pulsar‑based message queue that separates storage and compute, offering multi‑protocol support, strong consistency, high reliability, active‑active cross‑region replication, and read‑only broker scaling to meet financial‑grade billing workloads with billions of daily transactions.

Apache PulsarDistributed SystemsFinancial Services
0 likes · 26 min read
Tencent TDMQ: Cloud‑Native Message Queue Architecture and Implementation
Big Data Technology & Architecture
Big Data Technology & Architecture
Jul 2, 2019 · Big Data

Integrating Apache Flink with Apache Pulsar for Scalable Elastic Data Processing

This article explains how Apache Pulsar and Apache Flink can be combined to provide a unified, scalable, and fault‑tolerant data processing platform, covering Pulsar's architecture, its differences from other messaging systems, various integration patterns, and concrete code examples for stream and batch workloads.

Apache FlinkApache PulsarBig Data
0 likes · 13 min read
Integrating Apache Flink with Apache Pulsar for Scalable Elastic Data Processing
Big Data Technology & Architecture
Big Data Technology & Architecture
Jun 11, 2019 · Backend Development

Introduction to Apache Pulsar: Architecture, Core Concepts, and Consumption Modes

This article provides an overview of Apache Pulsar, detailing its enterprise‑grade features, architectural components such as brokers, BookKeeper and ZooKeeper, core concepts like topics and metadata, and the supported consumption modes, illustrating why it is considered a next‑generation distributed messaging system.

Apache PulsarBackendDistributed Messaging
0 likes · 9 min read
Introduction to Apache Pulsar: Architecture, Core Concepts, and Consumption Modes
High Availability Architecture
High Availability Architecture
May 7, 2019 · Cloud Native

A Gentle Introduction to Apache Pulsar: Architecture, Features, and Use Cases

This article introduces Apache Pulsar, a cloud‑native pub/sub messaging platform that solves traditional messaging system limitations with a layered architecture, offering independent scaling, multi‑tenant isolation, cross‑region replication, zero rebalancing, unified queue‑and‑stream models, and built‑in functions and proxy support.

Apache PulsarDistributed SystemsMessaging
0 likes · 5 min read
A Gentle Introduction to Apache Pulsar: Architecture, Features, and Use Cases
Qunar Tech Salon
Qunar Tech Salon
Nov 14, 2018 · Big Data

Comparing Apache Pulsar and Apache Kafka: Message Models, Consumption, Acknowledgment, Retention, and Architecture

This article provides a detailed comparison between Apache Pulsar and Apache Kafka, covering their message consumption models (queue vs. stream), subscription types, acknowledgment mechanisms, retention policies, and underlying layered architecture, highlighting Pulsar's unified API and segment‑based storage advantages.

Apache KafkaApache PulsarDistributed Systems
0 likes · 21 min read
Comparing Apache Pulsar and Apache Kafka: Message Models, Consumption, Acknowledgment, Retention, and Architecture