JD Tech Talk
Apr 27, 2025 · Artificial Intelligence
Breaking the Hourglass Phenomenon of Residual Quantization: Enhancing the Upper Bound of Generative Retrieval
This paper investigates the "sandglass" phenomenon in residual‑quantized semantic identifiers for generative search and recommendation, analyzes its causes of path sparsity and long‑tail token distribution, and proposes heuristic and adaptive token‑removal methods that substantially improve model performance in e‑commerce scenarios.
Recommendation systemsadaptive token removalgenerative retrieval
0 likes · 10 min read