Old Zhang's AI Learning

Jul 12, 2026 · Artificial Intelligence

vLLM 0.25 Release: New Model Support, Multi‑Hardware, and Major Performance Boosts

The vLLM 0.25 update adds dozens of new model architectures, expands support to AMD ROCm, CPUs, Intel XPU and IBM Power, fixes speculative decoding for reasoning models, and introduces a suite of performance, KV‑cache, quantization, and API enhancements for large‑scale LLM inference.