SmartApe AI

Oct 23, 2026 · Artificial Intelligence

Agent Cache Engineering: Tsinghua & CUHK's AKV Cuts Inference Cost 27.7% via RSI

Tsinghua and CUHK researchers introduce Cache Engineering, a paradigm where AI agents directly manage KV cache via Append, Drop, and Repos operations, avoiding re-prefill costs; their open-source AKV system achieves 27.7% inference cost reduction and 1.7% higher task scores, while recursive self-improvement with MiniMax-M2.7 discovers even better cache policies.