How BIGO Scaled Real‑Time Messaging by Migrating from Kafka to Pulsar

BIGO replaced its Kafka‑based message‑flow platform with Apache Pulsar to overcome scaling, stability, and operational cost challenges, leveraging Pulsar’s storage‑compute separation, seamless horizontal expansion, low latency, and tight integration with Flink for real‑time ETL and AB‑test pipelines, resulting in billions of messages processed daily with half the hardware cost.

Apache PulsarETLFlink

0 likes · 17 min read

How BIGO Scaled Real‑Time Messaging by Migrating from Kafka to Pulsar

Java Backend Technology

Nov 12, 2018 · Backend Development

Why Didi Chose RocketMQ: Lessons from Building a Scalable Message Queue Service

This article recounts Didi's journey from a chaotic mix of Kafka, RocketMQ, Redis, and other queues to a unified, high‑performance messaging platform built on Apache RocketMQ, covering the reasons for abandoning Kafka, the architecture evolution, migration strategies, performance benchmarks, and operational enhancements.

Kafka migrationMessage QueueRocketMQ

0 likes · 17 min read

Why Didi Chose RocketMQ: Lessons from Building a Scalable Message Queue Service