Tagged articles

Muon

3 articles · Page 1 of 1

Jul 15, 2026 · Artificial Intelligence

Surprising Discovery: A Chinese embodied‑AI company solves the distributed Muon bottleneck

The article analyzes how the Muon optimizer, adopted by DeepSeek‑V4 and Kimi‑K2, suffers a 2.2× overhead in distributed training, and how the DMuon system from Zibian Robot reduces that overhead to near‑AdamW levels, achieving up to 97.4× speedup and only 2% slower end‑to‑end training than AdamW.

DMuonDistributed TrainingGPU Optimization

0 likes · 11 min read

Surprising Discovery: A Chinese embodied‑AI company solves the distributed Muon bottleneck

Machine Heart

May 30, 2026 · Artificial Intelligence

Solving AdamW & Muon Instability: Pion Optimizer Updates Large Models on an Iso‑Spectral Manifold

The Pion optimizer leverages iso‑spectral manifold updates to preserve the spectral norm of weight matrices, eliminating additive‑update instability and enabling stable, efficient training of billion‑parameter LLMs across pre‑training, fine‑tuning, and reinforcement‑learning stages, outperforming AdamW and Muon.

AdamWMuonPion optimizer

0 likes · 14 min read

Solving AdamW & Muon Instability: Pion Optimizer Updates Large Models on an Iso‑Spectral Manifold

Machine Heart

Apr 25, 2026 · Artificial Intelligence

How DeepSeek and Kimi’s Open‑Source Collaboration Is Redefining China’s AI Landscape

The article analyses DeepSeek V4’s technical report, revealing repeated “encounters” between DeepSeek and Kimi—shared MLA attention, Muon optimizer, and divergent long‑context strategies—while highlighting their open‑source releases, hardware adaptations, and ecosystem impact that dramatically lower deployment costs for Chinese AI.

AIDeepSeekKimi

0 likes · 10 min read

How DeepSeek and Kimi’s Open‑Source Collaboration Is Redefining China’s AI Landscape