Machine Heart

Sep 17, 2026 · Artificial Intelligence

World Synesthesia Model Achieves Robust Dexterous In-Hand Manipulation Under Real-World Perturbations

Sharpa Robotics' World Synesthesia Model (WSM), accepted at CoRL 2026, unifies visual geometry, tactile contact, proprioception, and action history into a reusable world model state, enabling a 22-DoF five-finger hand to achieve robust, generalizable in-hand rotation across unseen objects and real-world perturbations through clean depth supervision and recurrent memory.