Machine Learning Algorithms & Natural Language Processing

Oct 13, 2026 · Artificial Intelligence

LightRSI TokenPilot: Slash LLM Agent Context Costs Up to 87% with Smart Cleanup

Zhejiang University's LightRSI project introduces TokenPilot, an EMNLP 2026 accepted system for cache-efficient context management in LLM agents, combining prefix cache stabilization, tool output summarization, and task-level context cleaning to reduce inference costs by up to 87% on Claw-Eval while integrating with six coding agents and providing a visualization dashboard.