Skip to content
Tagged articles

AI research agents

3 articles · Page 1 of 1
Machine Heart
Machine Heart
Oct 11, 2026 · Artificial Intelligence

OpenRSI Index: Testing AI Research Agents on Real Tasks with 10K+ GPU Hours

OpenRSI Index evaluates AI agents on real open-source research projects — improving Marin's optimizer, Qwen's RL tasks, and GPIC image generation — using thousands of H100 hours, with isolated workspaces and independent verification to ensure reproducible progress beyond benchmark gaming.

AI research agentsBenchmark EvaluationGPU compute
0 likes · 13 min read
OpenRSI Index: Testing AI Research Agents on Real Tasks with 10K+ GPU Hours
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Sep 29, 2026 · Artificial Intelligence

AI That Builds AI: Naive AI's Self-Evolving Models Beat Top Benchmarks in 151 Experiments

Naive AI demonstrates AI-driven R&D where agents autonomously redesign model architectures, optimize training systems, and achieve breakthrough benchmarks—Naive-N0.5-Flash surpasses larger models on coding and research tasks, while AI-built NaiveRT delivers 30-50x inference speedups and AutoWM sets new world model records through self-discovered algorithms.

AI for AIAI research agentsInference Optimization
0 likes · 22 min read
AI That Builds AI: Naive AI's Self-Evolving Models Beat Top Benchmarks in 151 Experiments
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Sep 17, 2026 · Artificial Intelligence

AutoResearchExam: AI Research Agents Overfit to Validation Sets — Hidden Tests Reveal True Generalization After 24 Hours

Bespoke Labs' AutoResearchExam benchmarks nine frontier models on 29 open-ended ML research tasks for 24 hours each, revealing that validation-set gains often fail to transfer to hidden tests — exposing benchmark overfitting where models like GPT-5.6 Sol spend 55.5% of rounds on hyperparameter tuning, while Claude Fable 5.1 ultimately leads on time-weighted hidden-test AUARC despite Astra's early advantage.

AI research agentsAutoResearchExambenchmark overfitting
0 likes · 13 min read
AutoResearchExam: AI Research Agents Overfit to Validation Sets — Hidden Tests Reveal True Generalization After 24 Hours