BestHub
Sign in
Tagged articles

int4 quantization

2 articles · Page 1 of 1
Geek Labs
Geek Labs
Jul 14, 2026 · Artificial Intelligence

How Colibri Runs a 744 B MoE Model on CPU with Only 25 GB RAM

Colibri demonstrates that the 744‑billion‑parameter GLM‑5.2 MoE model can be executed on a pure‑CPU system using roughly 25 GB of memory by streaming expert weights from disk, int4‑quantizing dense parameters, and employing a compact C inference engine.

CPU inferenceGLM-5.2MLA attention
0 likes · 7 min read
How Colibri Runs a 744 B MoE Model on CPU with Only 25 GB RAM
SuanNi
SuanNi
Jun 12, 2026 · Artificial Intelligence

Kimi K2.7 Code Goes Open: 30% Token Savings and Major Coding Performance Boost

Kimi K2.7 Code, now open‑source on HuggingFace, reduces token consumption by ~30% and boosts coding benchmark scores—Kimi Code Bench v2 climbs from 50.9 to 62.0, Program‑Bench from 48.3 to 53.6, MLS Bench Lite from 26.7 to 35.1—narrowing the gap with GPT‑5.5 and Claude Opus, all built on a 1‑trillion‑parameter MoE architecture with INT4 quantization and a 256K‑token context.

HuggingFaceKimi K2.7LLM benchmarks
0 likes · 6 min read
Kimi K2.7 Code Goes Open: 30% Token Savings and Major Coding Performance Boost