How Kuaishou Scales YARN to Tens of Thousands of Nodes with the Kwai Scheduler

This article explains how Kuaishou’s massive offline compute clusters—tens of thousands of machines processing hundreds of petabytes daily—are managed by a heavily customized YARN stack and the home‑grown Kwai Scheduler, detailing architecture, scheduler evolution, multi‑scenario optimizations, and future scaling plans.

Big DataCluster OptimizationKwai Scheduler

0 likes · 14 min read

How Kuaishou Scales YARN to Tens of Thousands of Nodes with the Kwai Scheduler

Meituan Technology Team

Dec 27, 2018 · Artificial Intelligence

Meituan’s AI Initiatives: Large‑Scale Scheduling, Unmanned Delivery, and the Meituan Brain Knowledge Graph

Meituan’s AI division, now over 1,000 engineers with a 2 billion‑CNY quarterly budget, powers massive real‑time scheduling for 20 million daily orders, unmanned delivery pilots, and the “Meituan Brain” knowledge graph of billions of entities, delivering AI‑driven services across its entire platform.

AIBig DataLarge-Scale Scheduling

0 likes · 16 min read

Meituan’s AI Initiatives: Large‑Scale Scheduling, Unmanned Delivery, and the Meituan Brain Knowledge Graph

Efficient Ops

Nov 2, 2016 · Operations

How Tencent Achieved Zero‑Impact Disaster Recovery for Hundreds of Millions of Users

This article details Tencent's multi‑region disaster‑recovery architecture and rapid, user‑transparent scheduling techniques that enable seamless service continuity for QQ and Qzone across billions of daily users, illustrated through real‑world drills and performance metrics.

Large-Scale SchedulingOperationsTencent

0 likes · 16 min read

How Tencent Achieved Zero‑Impact Disaster Recovery for Hundreds of Millions of Users

Efficient Ops

Jan 19, 2016 · Operations

How QQ Achieves Massive Multi‑Region Scheduling and Resilient Operations

This article details Tencent’s QQ large‑scale scheduling architecture, covering multi‑site distribution, rapid dispatch mechanisms, cross‑region data synchronization, automated operation platform ZhiYun, flexible services, overload protection, rapid scaling, and comprehensive monitoring that together enable resilient, high‑performance social services.

Distributed SystemsLarge-Scale SchedulingOperations Automation

0 likes · 15 min read

How QQ Achieves Massive Multi‑Region Scheduling and Resilient Operations