Machine Learning Algorithms & Natural Language Processing

Nov 9, 2026 · Artificial Intelligence

MapFlow: Cross-Model Attention Map Reuse Cuts LLM Prefill Latency 15-20%

Peking University researchers introduce MapFlow, a system that reuses attention maps across different-sized LLMs to avoid recomputing shared context during model handoffs, reducing prefill latency by 15–20% and increasing multi-turn dialogue throughput up to 25% while maintaining generation quality.