Machine Heart

Jun 9, 2026 · Artificial Intelligence

How HRM-Text Achieves 1B‑Parameter, $1K Training Cost and State‑of‑the‑Art Benchmarks

HRM-Text, a 1‑billion‑parameter model trained for under two days on 16 H100 GPUs at a cost of about $1,500, uses a hierarchical recursive architecture, a focused answer‑only loss, and a PrefixLM mask to reach competitive scores on MATH, GSM8K, and ARC‑Challenge, demonstrating an efficient alternative to scaling‑only approaches.