Machine Heart

Jun 5, 2026 · Artificial Intelligence

Beyond Binary Success: Redefining Fine-Grained Manipulation Evaluation for Embodied AI

The paper introduces MetaFine, a diagnostic meta‑evaluation framework that moves robot manipulation assessment from a simple success/failure binary to a three‑dimensional analysis of understanding, perception, and behavior, revealing up to 70% over‑estimation in traditional benchmarks and offering a hybrid real‑sim testing pipeline for fair, reproducible results.