BestHub
Sign in
Tagged articles

AI profiling

5 articles · Page 1 of 1
Alibaba Cloud Native
Alibaba Cloud Native
Aug 23, 2026 · Artificial Intelligence

Why Is GPU Utilization Low? Try This Zero‑Intrusion AI Profiling Tool

The article introduces SysOM AI Profiling, a zero‑intrusive, cloud‑native performance observation and diagnosis solution for AI workloads that spans training to inference, single‑GPU to multi‑GPU clusters, and Python to GPU kernel layers, helping users pinpoint low GPU utilization, memory leaks, and communication bottlenecks.

AI profilingGPU utilizationMemory Leak Detection
0 likes · 14 min read
Why Is GPU Utilization Low? Try This Zero‑Intrusion AI Profiling Tool
Alibaba Cloud Infrastructure
Alibaba Cloud Infrastructure
Aug 4, 2026 · Artificial Intelligence

Why Is GPU Utilization Low and Hard to Diagnose? Try This Zero‑Intrusion AI Profiling Tool

Low GPU utilization and mysterious memory growth often stall AI workloads, but existing tools are intrusive and limited; SysOM AI Profiling offers zero‑intrusion, one‑click, multi‑dimensional analysis across training and inference, with timeline visualisation, memory‑snapshot, and iteration‑anchored diff, demonstrated by vLLM memory‑leak detection and SGLang vs vLLM performance comparison.

AI profilingGPU utilizationMemory Leak
0 likes · 11 min read
Why Is GPU Utilization Low and Hard to Diagnose? Try This Zero‑Intrusion AI Profiling Tool
Alibaba Cloud Infrastructure
Alibaba Cloud Infrastructure
May 1, 2025 · Artificial Intelligence

Fine-grained Profiling of Online AI Workloads on Kubernetes Using ACK AI Profiling

This article demonstrates how to use ACK AI Profiling, built on eBPF and dynamic process injection, to perform non-intrusive, low‑overhead profiling of Kubernetes‑deployed large‑language‑model inference services, identify GPU memory growth causes, and apply optimization recommendations to prevent OOM issues.

AI profilingGPU memoryKubernetes
0 likes · 10 min read
Fine-grained Profiling of Online AI Workloads on Kubernetes Using ACK AI Profiling
Linux Kernel Journey
Linux Kernel Journey
Nov 5, 2024 · Artificial Intelligence

Understanding AI Flame Graphs: Insights from Brendan Gregg

The article introduces Intel's AI Flame Graph, a low‑overhead profiling tool that visualizes AI accelerator and GPU workloads across the full software stack, explains its design, demonstrates SYCL matrix‑multiply benchmarks, discusses challenges of AI instruction analysis, and outlines future adoption and impact.

AI profilingGPUIntel
0 likes · 16 min read
Understanding AI Flame Graphs: Insights from Brendan Gregg
Linux Code Review Hub
Linux Code Review Hub
Nov 2, 2024 · Artificial Intelligence

Inside Intel’s AI Flame Graph: Low‑Overhead Profiling for Faster, Greener AI

The article introduces Intel’s AI Flame Graph, a low‑overhead profiling tool that visualizes AI accelerator and GPU execution alongside the full software stack, explains its design, shows SYCL matrix‑multiply examples, discusses challenges of AI workload analysis, and outlines future adoption and impact on performance and energy savings.

AI profilingGPUIntel
0 likes · 16 min read
Inside Intel’s AI Flame Graph: Low‑Overhead Profiling for Faster, Greener AI