vivo Internet Technology

Aug 19, 2026 · Artificial Intelligence

Octopus: History‑Free Gradient Orthogonalization for Continual Learning (CVPR 2026)

Octopus introduces a history‑free gradient orthogonalization (HiFGO) constraint and a two‑stage finetuning strategy that together eliminate catastrophic forgetting, achieve positive backward transfer, and set new SOTA results on the UCIT benchmark, improving Avg and Last metrics by 2.14% and 6.82% without extra inference cost.