dbaplus Community

Mar 22, 2022 · Operations

How Meituan Scales Kafka to 7,500 Nodes: Real-World Optimizations and Lessons

Meituan’s data platform runs Kafka on over 7,500 machines, handling daily traffic exceeding 21 PB, and tackles latency, slow nodes, and massive cluster management through layered optimizations—including disk balancing, pipeline acceleration, fetcher isolation, cgroup isolation, SSD caching, isolation strategies, full‑link monitoring, lifecycle management, and TOR disaster recovery.