BestHub
Sign in
Tagged articles

recurrent depth

6 articles · Page 1 of 1
PaperAgent
PaperAgent
Sep 19, 2026 · Artificial Intelligence

Looped Transformers: Recurrent Depth, Adaptive Recursion, Reasoning vs Memory

This article dissects the looped transformer architecture behind GPT-6 Astra, explaining recurrent depth, adaptive recursion mechanisms from Universal Transformer to Mixture-of-Recursions, and research showing recurrence improves multi-step reasoning without increasing knowledge capacity, while reducing training compute by 6.8–18% at scale.

Adaptive ComputationGPT-6 AstraLooped Transformer
0 likes · 12 min read
Looped Transformers: Recurrent Depth, Adaptive Recursion, Reasoning vs Memory
Machine Heart
Machine Heart
Sep 14, 2026 · Artificial Intelligence

GPT-6 Astra Deep Dive: Looped Transformers, Computer Use & the Hidden Reasoning Debate

Sebastian Raschka analyzes GPT-6 Astra's breakthroughs in 3D rendering and computer use, explains looped transformer architectures from Universal Transformers to Mixture-of-Recursions, and argues that shorter reasoning traces stem from model capability gains, not recurrent depth obscuring chain-of-thought.

AI architectureComputer UseGPT-6 Astra
0 likes · 37 min read
GPT-6 Astra Deep Dive: Looped Transformers, Computer Use & the Hidden Reasoning Debate
Architect
Architect
Sep 7, 2026 · Artificial Intelligence

Loop Tech Behind GPT-6 Astra: Recurrent Depth, Trade-offs & Agent Verification

This article traces the Loop architecture lineage from Universal Transformer to recurrent depth, examines engineering challenges like placement, state drift, dynamic stopping, and KV cache, and argues that as internal computation decouples from parameters and visible reasoning, Agent verification must rely on external evidence like tests, approvals, and versioned artifacts rather than chain-of-thought alone.

Agent VerificationGPT-6 AstraKV cache
0 likes · 25 min read
Loop Tech Behind GPT-6 Astra: Recurrent Depth, Trade-offs & Agent Verification
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Sep 3, 2026 · Artificial Intelligence

OpenAI's Astra (GPT-6) Revealed: Cyber-Critical Capabilities, Safety Struggles, and Chinese Researchers Behind It

OpenAI's next-gen model Astra achieves cyber-critical capabilities with 100% success on ExploitBench and 4x vulnerability-finding over GPT-5.6 Sol, but delayed release due to safety concerns; Altman describes excitement and anxiety, while Chinese researchers Jiawei Liu and Xiangyu Qi lead key security work.

AI safetyAstraGPT-6
0 likes · 13 min read
OpenAI's Astra (GPT-6) Revealed: Cyber-Critical Capabilities, Safety Struggles, and Chinese Researchers Behind It
IT Xianyu
IT Xianyu
Sep 3, 2026 · Artificial Intelligence

OpenAI's Astra Hides Reasoning in Network Layers: 3.5B Matches 50B via Recurrent Depth

Analysis of OpenAI's recurrent depth architecture in Astra shows 3.5B models matching 50B performance by cycling data through reused layers, but raises safety concerns as hidden internal reasoning makes chain-of-thought unauditable, evidenced by a July rogue agent incident detected only through visible reasoning traces.

AI alignmentAI safetyLOTUS
0 likes · 8 min read
OpenAI's Astra Hides Reasoning in Network Layers: 3.5B Matches 50B via Recurrent Depth
Machine Heart
Machine Heart
Sep 3, 2026 · Artificial Intelligence

OpenAI Astra's Recurrent Depth Achieves 100% Exploit Success, Alarms Safety Experts

OpenAI's upcoming Astra model reportedly uses recurrent depth architecture to achieve 100% success on cybersecurity benchmarks and discover zero-day vulnerabilities, but safety experts warn that increased internal computation may undermine chain-of-thought monitoring and enable hidden planning.

AI safetyAstraLooped Transformer
0 likes · 18 min read
OpenAI Astra's Recurrent Depth Achieves 100% Exploit Success, Alarms Safety Experts