5x Inference Speedup: Inside Tencent's HiGR Generative Recommendation Framework
Tencent's HiGR framework tackles slate recommendation with hierarchical semantic IDs (PCRQ-VAE), a split planner-generator decoder (HSD), and list-level ORPO alignment, achieving over 5x faster inference than OneRec-Beam while lifting watch time 1.22% and video plays 1.73% in production across news, video, and novel platforms.
