BestHub
Sign in
Tagged articles

Partition Balancing

2 articles · Page 1 of 1
Smart Era Software Development
Smart Era Software Development
Nov 3, 2023 · Operations

Inside Bilibili’s Kafka: Challenges, Guardian Federation, and Future Automation

The article details how Bilibili operates over 1,000 Kafka nodes across 20+ clusters, outlines the scalability and stability challenges they faced, and explains the design and implementation of their self‑built Guardian federation controller, partition‑level throttling, automatic balancing, multi‑tenant isolation, tiered storage, audit, and automated ops workflows.

AutomationCluster GovernanceMulti-tenant Isolation
0 likes · 21 min read
Inside Bilibili’s Kafka: Challenges, Guardian Federation, and Future Automation
dbaplus Community
dbaplus Community
Apr 1, 2021 · Backend Development

Avoid Kafka Pitfalls: Ensuring Message Order, Handling Retries, and Preventing Backlog

This article shares a two‑year journey of using Kafka in a high‑traffic restaurant ordering system, covering why message order matters, how network glitches and partition routing cause failures, and the practical retry, partition‑balancing, and database strategies that finally eliminated backlog and duplication issues.

Backend DevelopmentMessage OrderingPartition Balancing
0 likes · 19 min read
Avoid Kafka Pitfalls: Ensuring Message Order, Handling Retries, and Preventing Backlog