Tagged articles

multi-router MoE

2 articles · Page 1 of 1
SmartApe AI
SmartApe AI
Nov 5, 2026 · Artificial Intelligence

Baidu's ERNIE-5.5-Flash-Base: 280B MoE Hits Same-Size SOTA with 14B Active Params

Baidu open-sources ERNIE-5.5-Flash-Base, a 280B-parameter sparse MoE model activating only 14B parameters per token, trained on 33.5T tokens with 128K context, achieving same-size SOTA against DeepSeek-V4-Flash-Base and others through hybrid sparse attention, multi-router latent MoE, and ECHO future-token prediction.

BaiduECHOERNIE-5.5-Flash-Base
0 likes · 19 min read
Baidu's ERNIE-5.5-Flash-Base: 280B MoE Hits Same-Size SOTA with 14B Active Params
Machine Heart
Machine Heart
Nov 5, 2026 · Artificial Intelligence

Baidu Open-Sources ERNIE 5.5 Flash Base: Efficient 280B MoE for Agents

Baidu releases ERNIE 5.5 Flash Base, a 280B sparse MoE model with 14B activated parameters, 128K training context extended to 1M at inference, featuring hybrid sparse attention (MLA+HCA), multi-router MoE, and ECHO future-token prediction, achieving SOTA benchmarks against DeepSeek-V4-Flash and other peers.

ECHOERNIE 5.5 Flash BaseLong Context
0 likes · 18 min read
Baidu Open-Sources ERNIE 5.5 Flash Base: Efficient 280B MoE for Agents