SmartApe AI

Nov 5, 2026 · Artificial Intelligence

Baidu's ERNIE-5.5-Flash-Base: 280B MoE Hits Same-Size SOTA with 14B Active Params

Baidu open-sources ERNIE-5.5-Flash-Base, a 280B-parameter sparse MoE model activating only 14B parameters per token, trained on 33.5T tokens with 128K context, achieving same-size SOTA against DeepSeek-V4-Flash-Base and others through hybrid sparse attention, multi-router latent MoE, and ECHO future-token prediction.