DeepHub IMBA

Oct 26, 2026 · Backend Development

vLLM Adds FP8 W8A8 Kernel for AMD Strix Halo, Up to 2.54x GEMM Speedup

vLLM's PR #63199 introduces a dedicated FP8 W8A8 Blockscale GEMM kernel for AMD's gfx1151 (RDNA 3.5) architecture, accelerating specific small-batch matrix multiplications by 1.70–2.54x and improving end-to-end generation throughput by ~6.8% on Ryzen AI MAX+ 395, though the PR remains in draft and covers only a subset of FP8 operations.