SmartApe AI
Oct 28, 2026 · Artificial Intelligence
Qwen 4 Imminent: Leaked Code & Anonymous Models Reveal Architecture Details
Community clues suggest Alibaba's Qwen 4 is near release, with inference optimizations in vLLM and llama.cpp, architectural details like a 27B dense model with 5120 hidden dim, 24 query heads, 4 KV heads, 4 residual streams, MTP, and QSA sparse attention, while anonymous Arena models Kalmia and Kerria are speculated as Qwen 4 variants showing strong code and 3D generation.
AlibabaArena benchmarkFP8 quantization
0 likes · 7 min read