Skip to content
Tagged articles

hierarchical queue

1 articles · Page 1 of 1
DataFunSummit
DataFunSummit
Feb 16, 2025 · Big Data

Bilibili Big Data Task Migration to Cloud‑Native Kubernetes Using Volcano Scheduler

This article shares Bilibili’s experience migrating its offline big‑data workloads to a cloud‑native Kubernetes environment using the Volcano scheduler, covering migration background, scheduler adaptation, hierarchical queue implementation, over‑commit framework (Amiyad), and future work to improve performance and resource utilization.

Cloud NativeResource OvercommitVolcano Scheduler
0 likes · 15 min read
Bilibili Big Data Task Migration to Cloud‑Native Kubernetes Using Volcano Scheduler