Machine Heart

Jun 5, 2026 · Artificial Intelligence

Do LLMs Need Sleep? CMU Paper Shows Memory Consolidation Improves Reasoning

Researchers from CMU and collaborators propose a ‘sleep’ phase for transformer‑based LLMs that repeatedly re‑processes accumulated context to update fast weights in a state‑space module, enabling memory consolidation that reduces KV‑cache pressure and markedly improves performance on long‑context, multi‑step reasoning benchmarks.