Tagged articles
GPU interconnect
15 articles · Page 1 of 1
This article dissects NVIDIA's Pascal architecture via the Tesla P100, detailing its 16nm process, HBM2 memory delivering 732 GB/s bandwidth, FP16 support via FP32 units achieving 21.2 TFLOPS, and NVLink 1.0 providing 160 GB/s GPU interconnect bandwidth, with comparative calculations across GPU generations.
FP16FP32FP64
0 likes · 21 min read

The article analyzes the definition, technical traits, and three classifications of supernodes (SuperNode, SuperPoD, SuperCluster), explains how they boost large‑model training and inference efficiency, and examines the evolution of domestic supernode architectures, interconnects, and ecosystem design.
AI TrainingGPU interconnectHigh-Performance Computing
0 likes · 9 min read

This article explains how InfiniBand’s architecture, native RDMA, GPUDirect, and evolving bandwidth enable ultra‑low‑latency, high‑throughput communication for AI model training, compares it with Ethernet, and details the role of RoCEv2 and other high‑performance interconnect technologies.
AI TrainingGPU interconnectInfiniBand
0 likes · 9 min read

This article examines the architectural differences between Scale‑Out and Scale‑Up networking, compares PCIe, NVLink, UALink, Infiniband and RoCE, and explains why high‑bandwidth, low‑latency GPU interconnects like NVLink are essential for modern AI and HPC workloads.
AI accelerationGPU interconnectHigh-Performance Computing
0 likes · 27 min read

This article, part of the 2025 AI Network Technology Whitepaper, classifies AI high‑performance networking into Scale‑Up, Scale‑Out, and frontier breakthroughs, then dives deep into NVLink’s evolution, technical features, NVSwitch’s full‑mesh architecture, and the newly opened NVLink Fusion ecosystem.
AI networkingGPU interconnectHigh-Performance Computing
0 likes · 8 min read

This article examines the differences between Scale‑Out and Scale‑Up networking in AI compute clusters, comparing PCIe, Ethernet, InfiniBand, NVLink, UALink, and emerging standards like UB‑Mesh, and explains how each technology impacts bandwidth, latency, scalability, and cost for large‑scale model training.
AI TrainingGPU interconnectNVLink
0 likes · 28 min read

NVLink, NVIDIA's high‑bandwidth interconnect introduced with the P100 GPU, replaces PCIe by offering significantly higher data rates and lower latency for GPU‑GPU and GPU‑CPU communication, and has evolved through multiple generations to support modern AI and high‑performance computing workloads.
AI accelerationGPU interconnectNVIDIA
0 likes · 9 min read

This article examines NVIDIA's NVSwitch technology, explaining why it was needed, how it builds on NVLink to overcome PCIe bottlenecks, tracing its evolution from Pascal to the third‑generation design, and detailing its architectural features, scalability, full‑duplex bandwidth, non‑blocking communication, and optimized network topologies for high‑performance AI and HPC systems.
AI hardwareGPU interconnectHigh-Performance Computing
0 likes · 9 min read

With modern large‑language‑model workloads demanding massive parallelism, 8‑GPU servers have become the norm; this article explains the roles of CPUs, compares GPU‑to‑GPU interconnect options—including PCIe direct, PCIe Switch, NVLink, and NVSwitch—detailing their architectures, bandwidths, topologies, and trade‑offs for AI training.
8-GPU serverAI TrainingGPU interconnect
0 likes · 14 min read

The article analyzes the networking challenges of AI super‑large models, comparing InfiniBand and RoCE technologies, and presents design guidelines for ultra‑scale, high‑bandwidth, low‑latency, and highly stable cluster interconnects to maximize GPU utilization and overall training efficiency.
AIGPU interconnectHigh‑Performance Computing
0 likes · 14 min read

Using a martial‑arts analogy, the article explains why training massive AI models now requires thousands of GPUs or mixed‑chip clusters, outlines three key steps—inter‑connect, distributed parallel strategies, and accelerator acceleration—and shows how Baidu’s Baige platform achieves near‑full efficiency across GPU, Kunlun and Ascend chips.
AI TrainingGPU interconnectaccelerator optimization
0 likes · 11 min read

Based on TrendForce data, AI server shipments are projected to grow at a 12.2% CAGR through 2027, while advances in PCIe switching, retiming chips, and high‑speed GPU interconnects such as NVLink and NVSwitch are reshaping the architecture and performance of next‑generation AI compute platforms.
AI serversGPU interconnectHigh-Performance Computing
0 likes · 11 min read

This article provides an in‑depth technical analysis of NVIDIA NVLink, covering its evolution, the NVSwitch chip, NVLink‑enabled servers and switches, and a performance comparison with InfiniBand networks, highlighting its impact on high‑performance computing and artificial intelligence workloads.
GPU interconnectHPCNVLink
0 likes · 9 min read

The article introduces NVIDIA’s third‑generation NVLink technology, detailing its high‑bandwidth GPU‑GPU and GPU‑CPU interconnect, key architectural breakthroughs such as the Ampere‑based A100 GPU, multi‑instance GPU, and NVSwitch, and discusses its impact on AI, HPC, and graphics workloads.
GPU interconnectHigh-performance computingNVIDIA
0 likes · 7 min read

This article explains NVIDIA's NVLink interconnect technology, covering its history, protocol layers, bandwidth advantages over PCIe, topologies such as the HGX-1/DGX-1 mesh, the NVSwitch extension, and performance gains for deep‑learning and high‑performance computing workloads.
AI accelerationGPU interconnectNVIDIA
0 likes · 7 min read
