PaperAgent
Sep 19, 2026 · Artificial Intelligence
Looped Transformers: Recurrent Depth, Adaptive Recursion, Reasoning vs Memory
This article dissects the looped transformer architecture behind GPT-6 Astra, explaining recurrent depth, adaptive recursion mechanisms from Universal Transformer to Mixture-of-Recursions, and research showing recurrence improves multi-step reasoning without increasing knowledge capacity, while reducing training compute by 6.8–18% at scale.
Adaptive ComputationGPT-6 AstraLooped Transformer
0 likes · 12 min read