Tagged articles

Universal Transformer

2 articles · Page 1 of 1

Sep 19, 2026 · Artificial Intelligence

Looped Transformers: Recurrent Depth, Adaptive Recursion, Reasoning vs Memory

This article dissects the looped transformer architecture behind GPT-6 Astra, explaining recurrent depth, adaptive recursion mechanisms from Universal Transformer to Mixture-of-Recursions, and research showing recurrence improves multi-step reasoning without increasing knowledge capacity, while reducing training compute by 6.8–18% at scale.

Adaptive ComputationGPT-6 AstraLooped Transformer

0 likes · 12 min read

Looped Transformers: Recurrent Depth, Adaptive Recursion, Reasoning vs Memory

Architect

Sep 7, 2026 · Artificial Intelligence

Loop Tech Behind GPT-6 Astra: Recurrent Depth, Trade-offs & Agent Verification

This article traces the Loop architecture lineage from Universal Transformer to recurrent depth, examines engineering challenges like placement, state drift, dynamic stopping, and KV cache, and argues that as internal computation decouples from parameters and visible reasoning, Agent verification must rely on external evidence like tests, approvals, and versioned artifacts rather than chain-of-thought alone.

Agent VerificationGPT-6 AstraKV cache

0 likes · 25 min read

Loop Tech Behind GPT-6 Astra: Recurrent Depth, Trade-offs & Agent Verification