BestHub
Sign in
Tag

residual quantization

0 views collected around this technical thread.

JD Retail Technology
JD Retail Technology
Apr 27, 2025 · Artificial Intelligence

Addressing the “Sandglass” Bottleneck in Residual Quantization Semantic Identifiers for Generative Search and Recommendation

The paper identifies a “sandglass” bottleneck in Residual Quantization Semantic Identifiers, where middle‑layer tokens dominate, causing sparse paths and long‑tail distributions that hurt e‑commerce search performance, and demonstrates that adaptive pruning of these tokens restores accuracy and efficiency better than removing the layer entirely.

EMNLPSandglass BottleneckSemantic Identifier
0 likes · 11 min read
Addressing the “Sandglass” Bottleneck in Residual Quantization Semantic Identifiers for Generative Search and Recommendation
JD Tech Talk
JD Tech Talk
Apr 27, 2025 · Artificial Intelligence

Breaking the Hourglass Phenomenon of Residual Quantization: Enhancing the Upper Bound of Generative Retrieval

This paper investigates the "sandglass" phenomenon in residual‑quantized semantic identifiers for generative search and recommendation, analyzes its causes of path sparsity and long‑tail token distribution, and proposes heuristic and adaptive token‑removal methods that substantially improve model performance in e‑commerce scenarios.

Recommendation systemsadaptive token removalgenerative retrieval
0 likes · 10 min read
Breaking the Hourglass Phenomenon of Residual Quantization: Enhancing the Upper Bound of Generative Retrieval