Skip to content
Tagged articles

AKV

1 articles · Page 1 of 1
Machine Heart
Machine Heart
Nov 17, 2026 · Artificial Intelligence

Cache Engineering: Agents Directly Manage KV Cache to Cut Inference Costs 27.7%

Researchers from Tsinghua and CUHK propose Cache Engineering, a paradigm where agents directly manipulate KV cache via Append, Drop, and Repos operations, avoiding re-prefill overhead; their open-source AKV system reduces average inference cost by 27.7% and improves task success rate by 1.7% across four agent benchmarks.

AKVAgentCache Engineering
0 likes · 13 min read
Cache Engineering: Agents Directly Manage KV Cache to Cut Inference Costs 27.7%