InstEmb: Instruction-Following Embeddings that Anticipate Future Model Outputs
InstEmb introduces learnable look‑ahead tokens and dual‑anchor alignment pooling to inject output‑aware semantics into instruction‑following embeddings without extra decoding, achieving strong gains on ICML‑2026 benchmarks such as FollowIR and InfoSearch while maintaining competitive performance on general sentence‑embedding tasks.
