PRIME: Joint Pruning & Merging for MoE Expert Compression with 2.23× Throughput Gain
This article presents PRIME, a unified integer linear programming approach that jointly decides per-expert retention, merging, or pruning based on activation frequency and output similarity, reducing routed-expert count by 25% with only ~1% accuracy drop on code/math benchmarks, and demonstrates up to 2.23× throughput improvement in high-concurrency long-output serving via working-set reduction and KV-capacity expansion.
