Tag

Apache Pulsar

0 views collected around this technical thread.

vivo Internet Technology
vivo Internet Technology
Jun 4, 2025 · Cloud Native

Deep Dive into Apache Pulsar Producer: Architecture, Parameters, and Performance Tuning

This article provides a comprehensive analysis of Apache Pulsar's Producer component, detailing its message-sending workflow, key design principles, configuration parameters, and practical performance tuning techniques to improve throughput, reduce latency, and lower resource consumption in large‑scale cloud‑native messaging systems.

Apache PulsarMessagingcloud-native
0 likes · 26 min read
Deep Dive into Apache Pulsar Producer: Architecture, Parameters, and Performance Tuning
DataFunSummit
DataFunSummit
Jun 3, 2025 · Big Data

BiFang: A Unified Lake‑Stream Storage Engine for Real‑Time and Batch Data Processing

BiFang is a lake‑stream integrated storage engine that merges Apache Pulsar message‑queue capabilities with Iceberg data‑lake features, providing a single unified data store with full‑incremental queries, sub‑second visibility, exactly‑once semantics, and seamless integration with Flink, Spark, and StarRocks for both real‑time analytics and batch processing.

Apache IcebergApache PulsarBig Data
0 likes · 13 min read
BiFang: A Unified Lake‑Stream Storage Engine for Real‑Time and Batch Data Processing
Xiaohongshu Tech REDtech
Xiaohongshu Tech REDtech
Oct 23, 2024 · Backend Development

Pulsar vs RocketMQ: Architecture, Cost Benefits, and Migration Strategy for Xiaohongshu Online Messaging

Xiaohongshu replaced its RocketMQ‑based online messaging platform with Apache Pulsar, achieving up to 48% total cost reduction, 43% higher CPU utilization, 30% resource savings, and a latency drop from 20.2 ms to 5.7 ms through cloud‑native, elastic scaling and a phased migration strategy.

Apache PulsarMessage Queuecloud-native
0 likes · 12 min read
Pulsar vs RocketMQ: Architecture, Cost Benefits, and Migration Strategy for Xiaohongshu Online Messaging
360 Tech Engineering
360 Tech Engineering
May 10, 2024 · Cloud Native

Practical Experience of Deploying and Optimizing Apache Pulsar on Kubernetes at 360

This article shares the architecture design, cluster deployment, storage selection, multi‑region mode, service discovery, performance tuning, monitoring, alerting, and future plans of a production‑grade Apache Pulsar platform running on Kubernetes, providing valuable insights for engineers adopting Pulsar.

Apache PulsarDistributed MessagingKubernetes
0 likes · 17 min read
Practical Experience of Deploying and Optimizing Apache Pulsar on Kubernetes at 360
360 Smart Cloud
360 Smart Cloud
May 9, 2024 · Cloud Native

Practical Experience of Deploying and Optimizing Apache Pulsar on Kubernetes at 360

This article shares 360's practical experience deploying Apache Pulsar on Kubernetes, covering architecture design, storage choices, multi‑cluster modes, service discovery, performance tuning, monitoring, alerting, and future plans, offering valuable guidance for engineers building cloud‑native messaging platforms.

Apache PulsarDistributed MessagingKubernetes
0 likes · 19 min read
Practical Experience of Deploying and Optimizing Apache Pulsar on Kubernetes at 360
Didi Tech
Didi Tech
Jan 9, 2024 · Big Data

Introducing Apache Pulsar: Technical Benefits and Solutions for Didi Big Data Messaging System

Apache Pulsar, a cloud‑native distributed messaging platform, solves Didi Big Data’s DKafka bottlenecks by separating compute and storage, using sequential log writes, heterogeneous disks, multi‑level caching, bundle‑based load balancing and automatic scaling, dramatically improving stability while introducing richer monitoring complexity.

Apache PulsarBig DataCluster Management
0 likes · 17 min read
Introducing Apache Pulsar: Technical Benefits and Solutions for Didi Big Data Messaging System
360 Smart Cloud
360 Smart Cloud
Sep 13, 2023 · Backend Development

Introduction to Apache Pulsar Architecture and Features

This article introduces Apache Pulsar, an open‑source cloud‑native distributed messaging platform, detailing its storage‑compute separation architecture, multi‑tenant support, load balancing, fault tolerance, schema handling, functions, IO connectors, tiered storage, cross‑region replication, and operational commands for managing brokers, bookies, and namespaces.

Apache PulsarDistributed SystemsMessage Queue
0 likes · 20 min read
Introduction to Apache Pulsar Architecture and Features
Code Ape Tech Column
Code Ape Tech Column
Jul 4, 2023 · Backend Development

Guide to Using Apache Pulsar Java Client with Spring Boot

This tutorial explains how to deploy a single‑node Pulsar cluster with Docker, configure the Java client in a Spring Boot application, and create producers and consumers with detailed code examples and parameter explanations.

Apache PulsarConsumerDocker
0 likes · 11 min read
Guide to Using Apache Pulsar Java Client with Spring Boot
vivo Internet Technology
vivo Internet Technology
Sep 14, 2022 · Big Data

Exploring and Practicing Apache Pulsar at vivo: Cluster Management, Monitoring, and Optimization

The vivo big‑data team details how they migrated massive real‑time workloads from Kafka to Apache Pulsar, describing cluster‑level bundle and ledger management, retention policies, a Prometheus‑Kafka‑Druid monitoring pipeline, load‑balancing tweaks, client tuning, rapid broker‑failure recovery, and future cloud‑native tracing and migration plans.

Apache PulsarBig DataCluster Management
0 likes · 19 min read
Exploring and Practicing Apache Pulsar at vivo: Cluster Management, Monitoring, and Optimization
Laravel Tech Community
Laravel Tech Community
May 30, 2022 · Backend Development

Highlights of Apache Pulsar 2.10.0 Release: New Features and Bug Fixes

The Apache Pulsar 2.10.0 release introduces automatic cluster failover, lazy‑loading producers, new TableView support, enhanced broker interceptors, enriched client authentication, Etcd metadata storage, and numerous bug fixes, offering developers and operators a more flexible and performant messaging platform.

Apache PulsarBrokerClient
0 likes · 7 min read
Highlights of Apache Pulsar 2.10.0 Release: New Features and Bug Fixes
DataFunTalk
DataFunTalk
Apr 20, 2022 · Big Data

OpenMLDB Pulsar Connector: A Real‑time Data Integration Guide

This article presents a step‑by‑step tutorial on using the OpenMLDB Pulsar Connector to stream real‑time data from Apache Pulsar into OpenMLDB, covering connector architecture, key features, Docker‑based installation, sink configuration, schema registration, message production, verification queries, and future roadmap details.

Apache PulsarConnectorOpenMLDB
0 likes · 13 min read
OpenMLDB Pulsar Connector: A Real‑time Data Integration Guide
Tencent Cloud Developer
Tencent Cloud Developer
Jan 11, 2022 · Cloud Native

Apache Pulsar: Architecture, Topics, Producers, Consumers, and Storage

Apache Pulsar is a cloud‑native distributed messaging system that combines stateless brokers, a BookKeeper storage cluster, and ZooKeeper metadata to route messages from producers to consumers across scalable partitioned or non‑partitioned topics, supporting multiple subscription models, producer access modes, routing strategies, batching, acknowledgments, delayed delivery, and deduplication.

Apache PulsarBookKeeperConsumer
0 likes · 26 min read
Apache Pulsar: Architecture, Topics, Producers, Consumers, and Storage
Tencent Cloud Developer
Tencent Cloud Developer
Dec 24, 2021 · Cloud Native

Deep Dive into Apache Pulsar Message Acknowledgment Mechanism

Apache Pulsar ensures reliable delivery by letting consumers acknowledge messages individually, cumulatively, or within batches, while also supporting negative acknowledgments and sophisticated tracking mechanisms that batch ack requests, use BitSet for batch indexes, and employ time‑wheel‑based redelivery for unacknowledged messages.

Apache PulsarConsumer TrackerDistributed Messaging
0 likes · 10 min read
Deep Dive into Apache Pulsar Message Acknowledgment Mechanism
High Availability Architecture
High Availability Architecture
Dec 24, 2021 · Backend Development

Understanding Broker‑Side Message Acknowledgment and Cursor Management in Apache Pulsar

This article explains how Apache Pulsar brokers track consumer acknowledgment using cursors, describes persistent and non‑persistent subscription differences, details cursor metadata stored in ZooKeeper and BookKeeper, and outlines optimizations for handling message gaps, including RangeSet improvements and a new LRU‑based storage design.

Apache PulsarBookKeeperBroker
0 likes · 12 min read
Understanding Broker‑Side Message Acknowledgment and Cursor Management in Apache Pulsar
Tencent Cloud Developer
Tencent Cloud Developer
Jul 13, 2021 · Backend Development

Function Mesh: Serverless Innovation in Message and Streaming Data Scenarios

The talk by Zha Jia showcases StreamNative’s open‑source Function Mesh, which builds on Apache Pulsar’s unified messaging and streaming platform and its lightweight Pulsar Functions, using Kubernetes CRDs to simplify deployment, management, and scaling of serverless data processing while highlighting the project’s rapid community growth.

Apache PulsarBackend DevelopmentFunction Mesh
0 likes · 18 min read
Function Mesh: Serverless Innovation in Message and Streaming Data Scenarios
Full-Stack Internet Architecture
Full-Stack Internet Architecture
Jun 18, 2021 · Backend Development

Introducing Apache Pulsar and Its Integration with Spring Boot

This article introduces Apache Pulsar, outlines its key features and advantages over other messaging systems, and provides step‑by‑step Spring Boot integration code examples including dependencies, configuration, producer and consumer implementations for both normal and delayed messages.

Apache PulsarJavaMessage Queue
0 likes · 8 min read
Introducing Apache Pulsar and Its Integration with Spring Boot
macrozheng
macrozheng
Jun 8, 2021 · Backend Development

Master Apache Pulsar with Docker and Spring Boot: A Hands‑On Guide

This article provides a step‑by‑step tutorial on installing Apache Pulsar with Docker, managing it via Pulsar Manager, and integrating it into a Spring Boot application using the Pulsar Java Spring Boot starter, complete with code examples and UI screenshots.

Apache PulsarDockerJava
0 likes · 9 min read
Master Apache Pulsar with Docker and Spring Boot: A Hands‑On Guide
DataFunTalk
DataFunTalk
Jun 6, 2021 · Big Data

Understanding Apache Pulsar: Cloud‑Native Messaging, Storage‑Compute Separation, and Batch‑Stream Fusion with Flink

This article explains Apache Pulsar’s cloud‑native, storage‑compute separated architecture, its data model and scalability features, and how it integrates with Flink to provide a unified platform for both real‑time streaming and batch processing in big‑data applications.

Apache PulsarBatch-Stream IntegrationBig Data
0 likes · 17 min read
Understanding Apache Pulsar: Cloud‑Native Messaging, Storage‑Compute Separation, and Batch‑Stream Fusion with Flink
Tencent Cloud Developer
Tencent Cloud Developer
Apr 14, 2021 · Cloud Native

Apache Pulsar Meetup Shenzhen: Cloud-Native Distributed Messaging and Streaming Platform

The Apache Pulsar Meetup in Shenzhen on April 17, 2021, co‑hosted by Tencent Middleware and StreamNative, will showcase Pulsar’s cloud‑native messaging, streaming, and storage capabilities through sessions on KoP migration, big‑data and IoT use cases, cloud‑native deployments, and the StreamNative Cloud Pulsar‑as‑a‑Service offering.

Apache PulsarBackend DevelopmentDistributed Systems
0 likes · 7 min read
Apache Pulsar Meetup Shenzhen: Cloud-Native Distributed Messaging and Streaming Platform
Laravel Tech Community
Laravel Tech Community
Nov 19, 2020 · Backend Development

Apache Pulsar Go Client 0.3.0 Release Highlights

The Apache Pulsar Go client, a Go‑language SDK for the cloud‑native distributed messaging platform, has been updated to version 0.3.0, adding Key Shared support, schema capabilities for producers and consumers, and configurable reconnection retry attempts.

Apache PulsarDistributed MessagingGo client
0 likes · 2 min read
Apache Pulsar Go Client 0.3.0 Release Highlights