Tagged articles

11 articles

Page 1 of 1

Sep 29, 2025 · Artificial Intelligence

How NVLink and NVSwitch Power AI’s Next‑Gen High‑Performance Networks

This article, part of the 2025 AI Network Technology Whitepaper, classifies AI high‑performance networking into Scale‑Up, Scale‑Out, and frontier breakthroughs, then dives deep into NVLink’s evolution, technical features, NVSwitch’s full‑mesh architecture, and the newly opened NVLink Fusion ecosystem.

AI networkingGPU interconnectHigh‑performance computing

0 likes · 8 min read

How NVLink and NVSwitch Power AI’s Next‑Gen High‑Performance Networks

Architects' Tech Alliance

Apr 8, 2025 · Artificial Intelligence

How NVSwitch Revolutionizes Multi‑GPU Interconnect for AI Workloads

This article examines NVIDIA's NVSwitch technology, explaining why it was needed, how it builds on NVLink to overcome PCIe bottlenecks, tracing its evolution from Pascal to the third‑generation design, and detailing its architectural features, scalability, full‑duplex bandwidth, non‑blocking communication, and optimized network topologies for high‑performance AI and HPC systems.

AI hardwareGPU interconnectHigh‑performance computing

0 likes · 9 min read

How NVSwitch Revolutionizes Multi‑GPU Interconnect for AI Workloads

AI Cyberspace

Feb 8, 2025 · Artificial Intelligence

Why 8‑GPU Servers Are Essential for LLM Training and Which Interconnect Wins

With modern large‑language‑model workloads demanding massive parallelism, 8‑GPU servers have become the norm; this article explains the roles of CPUs, compares GPU‑to‑GPU interconnect options—including PCIe direct, PCIe Switch, NVLink, and NVSwitch—detailing their architectures, bandwidths, topologies, and trade‑offs for AI training.

8-GPU serverAI trainingGPU interconnect

0 likes · 14 min read

Why 8‑GPU Servers Are Essential for LLM Training and Which Interconnect Wins

Architects' Tech Alliance

Dec 14, 2024 · Industry Insights

Inside the High‑Performance GPU Server: A Deep Dive into A100/A800 & H100 Topologies

This article provides a detailed technical analysis of multi‑GPU server architectures, covering component breakdowns, NVSwitch networking, bandwidth calculations, and the differences between NVIDIA A100, A800, and H100 configurations for large‑scale AI workloads.

AI hardwareGPU architectureHigh‑performance computing

0 likes · 12 min read

Inside the High‑Performance GPU Server: A Deep Dive into A100/A800 & H100 Topologies

Architects' Tech Alliance

Dec 11, 2024 · Fundamentals

Unlocking GPU Computing: PCIe, NVLink, NVSwitch, and HBM Explained

This article breaks down the core components of high‑performance GPU servers—including PCIe switch chips, the evolution of NVLink from version 1.0 to 4.0, NVSwitch architecture, HBM memory tiers, and the nuances of bandwidth units—providing a comprehensive technical foundation for large‑scale model training.

GPU computingHBMHigh‑performance computing

0 likes · 10 min read

Unlocking GPU Computing: PCIe, NVLink, NVSwitch, and HBM Explained

Architects' Tech Alliance

May 15, 2024 · Artificial Intelligence

Detailed Overview of GPU Server Architectures: A100/A800 and H100/H800 Nodes

This article provides a comprehensive technical overview of large‑scale GPU server architectures, detailing the component topology of 8‑GPU A100/A800 and H100/H800 nodes, explaining storage network cards, NVSwitch interconnects, bandwidth calculations, and the trade‑offs between RoCEv2 and InfiniBand for AI workloads.

GPUHigh‑performance computingNVLink

0 likes · 13 min read

Detailed Overview of GPU Server Architectures: A100/A800 and H100/H800 Nodes

Architects' Tech Alliance

Apr 16, 2024 · Industry Insights

Inside AI Servers: PCIe, NVLink, and NVSwitch Driving the Next‑Gen Compute

Based on TrendForce data, AI server shipments are projected to grow at a 12.2% CAGR through 2027, while advances in PCIe switching, retiming chips, and high‑speed GPU interconnects such as NVLink and NVSwitch are reshaping the architecture and performance of next‑generation AI compute platforms.

AI serversGPU interconnectHigh‑performance computing

0 likes · 11 min read

Inside AI Servers: PCIe, NVLink, and NVSwitch Driving the Next‑Gen Compute

Architects' Tech Alliance

Apr 15, 2024 · Industry Insights

How NVIDIA NVLink is Transforming HPC and AI: Architecture, Switches, and Network Comparisons

This article provides an in‑depth technical analysis of NVIDIA NVLink, covering its evolution, the NVSwitch chip, NVLink‑enabled servers and switches, and a performance comparison with InfiniBand networks, highlighting its impact on high‑performance computing and artificial intelligence workloads.

GPU interconnectHPCNVLink

0 likes · 9 min read

How NVIDIA NVLink is Transforming HPC and AI: Architecture, Switches, and Network Comparisons

Architects' Tech Alliance

Apr 10, 2024 · Industry Insights

Inside the GPU Server: Architecture of A100/A800 and H100/H800 Nodes

This article provides a detailed technical breakdown of modern multi‑GPU server nodes, covering component composition, storage network cards, NVSwitch interconnects, bandwidth calculations, and the architectural differences between NVIDIA A100/A800 and H100/H800 configurations for AI training workloads.

A100AI trainingGPU

0 likes · 12 min read

Inside the GPU Server: Architecture of A100/A800 and H100/H800 Nodes

Architects' Tech Alliance

Apr 8, 2024 · Fundamentals

Unlocking GPU Server Architecture: PCIe, NVLink, NVSwitch & HBM Explained

This article provides a comprehensive breakdown of high‑performance GPU server infrastructure, covering PCIe generations, NVLink evolution, NVSwitch and NVLink switches, HBM memory technologies, and bandwidth measurement units, helping readers understand the hardware connections and performance considerations essential for large‑scale model training.

GPU architectureHBMHigh‑performance computing

0 likes · 10 min read

Unlocking GPU Server Architecture: PCIe, NVLink, NVSwitch & HBM Explained

Architects' Tech Alliance

Aug 31, 2022 · Artificial Intelligence

Performance Evaluation of Transformer Models on the Inspur NF5488A5 GPU Server

This article presents a detailed benchmark of four Transformer models of varying sizes trained on the high‑end Inspur NF5488A5 GPU server, compares its NVSwitch‑based interconnect with a PCIe‑based system, and analyzes the impact of model scale, tensor parallelism, and hardware bandwidth on training efficiency.

DeepSpeedGPU serverMegatron-LM

0 likes · 12 min read

Performance Evaluation of Transformer Models on the Inspur NF5488A5 GPU Server