Tagged articles

AI profiling

4 articles · Page 1 of 1
Alibaba Cloud Infrastructure
Alibaba Cloud Infrastructure
Aug 4, 2026 · Artificial Intelligence

Why Is GPU Utilization Low and Hard to Diagnose? Try This Zero‑Intrusion AI Profiling Tool

Low GPU utilization and mysterious memory growth often stall AI workloads, but existing tools are intrusive and limited; SysOM AI Profiling offers zero‑intrusion, one‑click, multi‑dimensional analysis across training and inference, with timeline visualisation, memory‑snapshot, and iteration‑anchored diff, demonstrated by vLLM memory‑leak detection and SGLang vs vLLM performance comparison.

AI profilingGPU utilizationSGLang
0 likes · 11 min read
Why Is GPU Utilization Low and Hard to Diagnose? Try This Zero‑Intrusion AI Profiling Tool
Alibaba Cloud Infrastructure
Alibaba Cloud Infrastructure
May 1, 2025 · Artificial Intelligence

Fine-grained Profiling of Online AI Workloads on Kubernetes Using ACK AI Profiling

This article demonstrates how to use ACK AI Profiling, built on eBPF and dynamic process injection, to perform non-intrusive, low‑overhead profiling of Kubernetes‑deployed large‑language‑model inference services, identify GPU memory growth causes, and apply optimization recommendations to prevent OOM issues.

AI profilingGPU memoryKubernetes
0 likes · 10 min read
Fine-grained Profiling of Online AI Workloads on Kubernetes Using ACK AI Profiling
Linux Kernel Journey
Linux Kernel Journey
Nov 5, 2024 · Artificial Intelligence

Understanding AI Flame Graphs: Insights from Brendan Gregg

The article introduces Intel's AI Flame Graph, a low‑overhead profiling tool that visualizes AI accelerator and GPU workloads across the full software stack, explains its design, demonstrates SYCL matrix‑multiply benchmarks, discusses challenges of AI instruction analysis, and outlines future adoption and impact.

AI profilingGPUIntel
0 likes · 16 min read
Understanding AI Flame Graphs: Insights from Brendan Gregg
Linux Code Review Hub
Linux Code Review Hub
Nov 2, 2024 · Artificial Intelligence

Inside Intel’s AI Flame Graph: Low‑Overhead Profiling for Faster, Greener AI

The article introduces Intel’s AI Flame Graph, a low‑overhead profiling tool that visualizes AI accelerator and GPU execution alongside the full software stack, explains its design, shows SYCL matrix‑multiply examples, discusses challenges of AI workload analysis, and outlines future adoption and impact on performance and energy savings.

AI profilingGPUIntel
0 likes · 16 min read
Inside Intel’s AI Flame Graph: Low‑Overhead Profiling for Faster, Greener AI