Skip to content
Tagged articles

router reconstruction

1 articles · Page 1 of 1
Baidu Intelligent Cloud Tech Hub
Baidu Intelligent Cloud Tech Hub
Oct 19, 2026 · Artificial Intelligence

PRIME: Joint Pruning & Merging for MoE Expert Compression with 2.23× Throughput Gain

This article presents PRIME, a unified integer linear programming approach that jointly decides per-expert retention, merging, or pruning based on activation frequency and output similarity, reducing routed-expert count by 25% with only ~1% accuracy drop on code/math benchmarks, and demonstrates up to 2.23× throughput improvement in high-concurrency long-output serving via working-set reduction and KV-capacity expansion.

MoEexpert compressioninteger linear programming
0 likes · 21 min read
PRIME: Joint Pruning & Merging for MoE Expert Compression with 2.23× Throughput Gain