Tagged articles
1 articles
Page 1 of 1
JD Cloud Developers
JD Cloud Developers
Jul 24, 2024 · Operations

How JD.com’s Buffalo Scheduler Achieves High‑Performance, Scalable DAG Orchestration

Buffalo, JD.com’s in‑house distributed DAG scheduler, tackles massive task volumes and complex dependencies through a dual‑layer entity model, instance‑based execution, tiered scheduling, high‑availability architecture, event‑driven processing, in‑memory and cold‑hot data separation, delivering scalable, low‑latency ETL orchestration.

DAG schedulingDistributed SystemsETL orchestration
0 likes · 12 min read
How JD.com’s Buffalo Scheduler Achieves High‑Performance, Scalable DAG Orchestration