Baobao Algorithm Notes
Oct 25, 2024 · Artificial Intelligence
Why Calibration Data Outperforms Pruning Algorithms in LLM Compression
This study investigates how the choice of calibration data, rather than the pruning algorithm itself, dominates post‑training pruning performance for large language models, revealing that data similarity to the original training set and synthetic data generation can significantly boost compression results.
LLM pruningartificial intelligencecalibration data
0 likes · 14 min read