PaperAgent
Nov 14, 2026 · Artificial Intelligence
RSI Closed-Loop Pre-Training Reaches Frontier Scale, Surpasses Qwen3-30B-A3B
The article details the first public case of applying recursive self-improvement (RSI) closed loops to full frontier-scale pre-training, producing the 801-30B-A3B MoE model trained on 11.8T tokens, which outperforms Qwen3-30B-A3B and Nemotron-3.5-Lightning-30B-A3B through three types of feedback loops and agent-generated training data.
BenchmarkingMixture of ExpertsRSI
0 likes · 9 min read
