Alibaba Cloud Infrastructure
May 1, 2025 · Artificial Intelligence
Fine-grained Profiling of Online AI Workloads on Kubernetes Using ACK AI Profiling
This article demonstrates how to use ACK AI Profiling, built on eBPF and dynamic process injection, to perform non-intrusive, low‑overhead profiling of Kubernetes‑deployed large‑language‑model inference services, identify GPU memory growth causes, and apply optimization recommendations to prevent OOM issues.
AI profilingGPU memoryKubernetes
0 likes · 10 min read