Jul 20, 2026 · Artificial Intelligence

InstEmb: Future‑Aware Instruction‑Following Embeddings for Product Knowledge Representation

InstEmb introduces learnable look‑ahead tokens and dual‑anchor alignment pooling to inject future output semantics into embeddings, enabling instruction‑following tasks such as product retrieval to achieve strong performance without any extra decoding overhead.

InstEmbLLaMA-3dual-anchor pooling

0 likes · 15 min read

InstEmb: Future‑Aware Instruction‑Following Embeddings for Product Knowledge Representation

JD Retail Technology

Jul 20, 2026 · Artificial Intelligence

InstEmb: Instruction-Following Embeddings that Anticipate Future Model Outputs

InstEmb introduces learnable look‑ahead tokens and dual‑anchor alignment pooling to inject output‑aware semantics into instruction‑following embeddings without extra decoding, achieving strong gains on ICML‑2026 benchmarks such as FollowIR and InfoSearch while maintaining competitive performance on general sentence‑embedding tasks.

ICML 2026LLaMA-3dual-anchor pooling

0 likes · 15 min read

InstEmb: Instruction-Following Embeddings that Anticipate Future Model Outputs

look-ahead tokens

InstEmb: Future‑Aware Instruction‑Following Embeddings for Product Knowledge Representation

InstEmb: Instruction-Following Embeddings that Anticipate Future Model Outputs