Data Party THU

Oct 23, 2026 · Artificial Intelligence

Are We Over-Testing LLMs? Survey of Benchmark Compression Methods, Costs & Reliability

This survey reviews 119 studies on benchmark compression for efficient LLM evaluation, categorizing methods into static compression, adaptive evaluation, and benchmark analysis, while emphasizing that reliable compression requires defining evaluation goals, verifying coverage, and accounting for full lifecycle costs rather than simply reducing test items.