Machine Learning Algorithms & Natural Language Processing

Jul 6, 2026 · Artificial Intelligence

Running GLM‑5.2 on AMD: 2,626 Tokens/s at Half Nvidia’s Cost

Wafer demonstrates that the open‑source GLM‑5.2 model can run on AMD’s MI355X GPU at 2,626 tokens per second with single‑stream throughput of 213 tokens per second, achieving comparable performance to Nvidia’s B200 at less than half the cost, by applying MXFP4 quantization, selecting the sglang engine, and fixing naming and kernel issues.