Machine Heart

Nov 1, 2026 · Artificial Intelligence

Road MOPD: Harmonizing Conflicting Expert Teachers in Multi-Domain Distillation

JD Retail and Nanjing University propose Road MOPD, a multi-teacher online policy distillation method that uses cross-teacher feedback on the same student response to strengthen consensus signals, weaken divergent signals, and project away conflicting gradient components, enabling simultaneous improvement across high-conflict domain pairs like math+medical and code+medical on Qwen3 models.