Architects' Tech Alliance

Nov 6, 2026 · Artificial Intelligence

Harvard GPU Lecture Notes: Roofline Analysis of LLM Inference on Hopper & Blackwell

Harvard lecture notes explain GPU hardware principles for LLMs, using the Roofline model to contrast compute-bound prefill vs. memory-bound decode phases, detailing Hopper/Blackwell architectures, memory hierarchy, multi-GPU scaling, and comparing NVIDIA with AMD MI355X, Google TPU Ironwood, and AWS Trainium3 accelerators.