Machine Heart

Nov 4, 2026 · Artificial Intelligence

RaPO: Retention-Aware Policy Optimization Fixes Catastrophic Forgetting in MLLMs

HKU researchers propose RaPO, a reinforcement fine-tuning method that adds a retention reward based on trajectory-level drift to prevent catastrophic forgetting in multimodal large language models during visual continual learning, achieving state-of-the-art results on five benchmarks with minimal forgetting.