Machine Learning Algorithms & Natural Language Processing
Nov 9, 2026 · Artificial Intelligence
MapFlow: Cross-Model Attention Map Reuse Cuts LLM Prefill Latency 15-20%
Peking University researchers introduce MapFlow, a system that reuses attention maps across different-sized LLMs to avoid recomputing shared context during model handoffs, reducing prefill latency by 15–20% and increasing multi-turn dialogue throughput up to 25% while maintaining generation quality.
LLM inferenceMapFlowPKU-DAIR
0 likes · 11 min read