Machine Heart
Nov 17, 2026 · Artificial Intelligence
Cache Engineering: Agents Directly Manage KV Cache to Cut Inference Costs 27.7%
Researchers from Tsinghua and CUHK propose Cache Engineering, a paradigm where agents directly manipulate KV cache via Append, Drop, and Repos operations, avoiding re-prefill overhead; their open-source AKV system reduces average inference cost by 27.7% and improves task success rate by 1.7% across four agent benchmarks.
AKVAgentCache Engineering
0 likes · 13 min read
