PaperAgent

Sep 19, 2026 · Artificial Intelligence

Looped Transformers: Recurrent Depth, Adaptive Recursion, Reasoning vs Memory

This article dissects the looped transformer architecture behind GPT-6 Astra, explaining recurrent depth, adaptive recursion mechanisms from Universal Transformer to Mixture-of-Recursions, and research showing recurrence improves multi-step reasoning without increasing knowledge capacity, while reducing training compute by 6.8–18% at scale.