BestHub
search
Sign in
Tag

global scheduling

1 views collected around this technical thread.

Bilibili Tech
Bilibili Tech
Mar 25, 2022 · Big Data

Bilibili's YARN Scheduling Optimization Practice: From Heartbeat-Driven to Global Scheduling

Bilibili transformed its YARN CapacityScheduler from a heartbeat‑driven design to a multi‑threaded global scheduler by separating lock handling, adopting Weighted Round‑Robin with DRF, adding batch node selection, fixing proposal inconsistencies, tuning GC and logging, and thereby reduced application allocation time by about 38 % on clusters of up to 8,000 nodes.

Big DataCapacitySchedulerHadoop
0 likes · 15 min read
Bilibili's YARN Scheduling Optimization Practice: From Heartbeat-Driven to Global Scheduling
Efficient Ops
Efficient Ops
Nov 8, 2017 · Operations

How Tencent Scaled Mobile QQ: From 500K to 180M Users with Global Smart Scheduling

This article details how Tencent's Mobile QQ grew from a half‑million online users to over 180 million by optimizing network access, evolving backend architecture from a single‑center to a three‑center design, and deploying a real‑time global smart‑scheduling system that reduces packet loss and login latency for both domestic and overseas users.

QQbackend architectureglobal scheduling
0 likes · 23 min read
How Tencent Scaled Mobile QQ: From 500K to 180M Users with Global Smart Scheduling