Can General LLMs Replace Robot Brains? First AA-Robotics Benchmark Reveals Gaps
Artificial Analysis's AA-Robotics benchmark tests GPT, Claude, and Gemini on real robot arm tasks like pouring and stacking, finding they succeed but take ~30 minutes per task at high cost, with low grasp success rates, highlighting gaps versus specialized embodied AI models.
