Alimama Tech

Jul 8, 2026 · Artificial Intelligence

Optimizing Qwen Series Inference with SGLang‑ATOM on AMD Instinct GPUs

Alibaba Mama AI Infra and AMD collaborated to integrate SGLang‑ATOM plugin mode for Qwen 3.5/3.6 models on MI308X GPUs, detailing multimodal, GDN, KV‑cache, and parallel‑strategy optimizations that achieve low‑latency, high‑throughput inference suitable for complex advertising workloads.