Skip to content
Tagged articles

runtime adaptation

4 articles · Page 1 of 1
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Oct 28, 2026 · Artificial Intelligence

BaGuaLu-2: Runtime-Adaptive Memory Management for MoE Training on 10K+ GPU Clusters

Tsinghua University's BaGuaLu-2 system dynamically selects per-operator recomputation or offloading after MoE gating to keep activation memory within device limits, achieving 1.14× throughput over baselines on 12,288 GPUs with 32.9% average MFU, zero config changes, and open-source code.

BaGuaLuGPU clustersMoE training
0 likes · 11 min read
BaGuaLu-2: Runtime-Adaptive Memory Management for MoE Training on 10K+ GPU Clusters
Machine Heart
Machine Heart
Oct 27, 2026 · Artificial Intelligence

BaGuaLu-2: Adaptive Activation Memory Management for MoE Training at Scale

Tsinghua's BaGuaLu-2, accepted at SC26, introduces runtime adaptive activation memory provisioning that dynamically selects recomputation and offloading per operator to handle MoE memory spikes on 12,288-GPU clusters, boosting throughput 1.14× and achieving 32.9% MFU without manual configuration.

BaGuaLu-2Huawei DCUMoE training
0 likes · 9 min read
BaGuaLu-2: Adaptive Activation Memory Management for MoE Training at Scale
Node Underground
Node Underground
Jul 27, 2020 · Cloud Computing

How Midway Serverless Enables Seamless Multi‑Cloud Application Migration

Midway Serverless v1.0 introduces a universal anti‑corruption layer that lets traditional EggJS applications be deployed to various cloud platforms with minimal code changes, offering a unified runtime adaptation, migration workflow, and outlining its advantages, limitations, and usage example.

Cloud MigrationEggJSMidway
0 likes · 5 min read
How Midway Serverless Enables Seamless Multi‑Cloud Application Migration