Mar 17, 2026 · Artificial Intelligence

Microsoft Open‑Sources BitNet: 1‑Bit Inference Framework Runs Billion‑Parameter Models on CPUs with Up to 6× Speedup

BitNet.cpp, Microsoft’s open‑source 1‑bit inference engine, enables billion‑parameter language models to run on ordinary CPUs, delivering 1.37‑6.17× speed improvements and 55‑82% energy reductions across ARM and x86 platforms, while providing a simple three‑step build‑and‑run workflow and broad hardware support.

1-bit quantizationBitNetCPU inference

0 likes · 8 min read

Microsoft Open‑Sources BitNet: 1‑Bit Inference Framework Runs Billion‑Parameter Models on CPUs with Up to 6× Speedup

DataFunTalk

Apr 19, 2025 · Artificial Intelligence

Microsoft Research's Open‑Source Native 1‑Bit LLM BitNet b1.58 2B4T: Design, Performance, and Deployment

Microsoft Research released BitNet b1.58 2B4T, the first open‑source native 1‑bit large language model with 2 billion parameters, 1.58‑bit effective precision and a 0.4 GB footprint, achieving full‑precision performance while enabling efficient CPU and GPU inference for edge AI applications.

1-bit quantizationCPU inferenceLLM

0 likes · 10 min read

Microsoft Research's Open‑Source Native 1‑Bit LLM BitNet b1.58 2B4T: Design, Performance, and Deployment