Machine Heart

Jul 29, 2026 · Artificial Intelligence

How Shanghai AI Lab Is Turning Pre‑training Into a Fully Open, Transparent Process

Shanghai AI Lab’s Shushu team launches ArchSpace, an open‑source platform that releases full model checkpoints, training logs, architecture decisions and validation results, inviting the community to submit and verify foundation‑model innovations such as Inter‑layer Attention and Sparse Attention across 1B‑8B scale models, with transparent logs on W&B and HuggingFace.