Machine Heart

Aug 24, 2026 · Artificial Intelligence

Can We Watch a 535B Model Train Live? Opening the Black Box of LLM Training

Stanford professor Percy Liang has launched the public, three‑month training of the 535B‑parameter Marin model, detailing its 18.75 trillion‑token dataset, 792 GB200 GPUs, 2.7e24 FLOPs compute, scaling‑ladder pre‑runs, and live monitoring links, sparking worldwide community interest.