Tagged articles
RoCEv2
13 articles · Page 1 of 1
veRoCE is a ByteDance‑engineered RDMA protocol that retains RoCEv2 compatibility while adding multi‑path transmission, native out‑of‑order delivery, efficient loss detection and selective retransmission, allowing high‑performance clusters to operate over lossy Ethernet without PFC.
RDMARoCEv2congestion control
0 likes · 12 min read

This article explains how InfiniBand’s architecture, native RDMA, GPUDirect, and evolving bandwidth enable ultra‑low‑latency, high‑throughput communication for AI model training, compares it with Ethernet, and details the role of RoCEv2 and other high‑performance interconnect technologies.
AI TrainingGPU interconnectInfiniBand
0 likes · 9 min read

The article explains how distributed AI training performance depends on reducing inter‑card communication latency, introduces RDMA technology and its implementations (InfiniBand, RoCEv2, iWARP), compares their latency and scalability against traditional TCP/IP, and outlines the hardware components and trade‑offs of InfiniBand and RoCEv2 networks.
InfiniBandRDMARoCEv2
0 likes · 12 min read

This article explores the hardware and networking foundations for training massive AI models, detailing the challenges of large‑scale RDMA deployment, the evolution of congestion‑control algorithms like DCQCN, TIMELY, HPCC, and AWS's SRD, and how hardware offload and programmable switches enable scalable, low‑latency AI infrastructure.
AWS SRDDCQCNHPCC
0 likes · 14 min read

RoCE, originally built for InfiniBand, was adapted to Ethernet as RoCEv2, which uses IP/UDP headers to enable L3 routing but is highly sensitive to packet loss, requiring a lossless network and employing technologies such as PFC, ECN, DCQCN, and multi‑path transmission to maintain high RDMA performance.
DCQCNECNPFC
0 likes · 17 min read

This article explains the motivations behind RDMA, describes its architecture, key components, and protocols such as RoCEv2, and discusses future technical challenges for scaling RDMA in large AI and HPC data‑center networks.
AI infrastructureRDMARoCEv2
0 likes · 19 min read

This article examines the two dominant AI compute network architectures, InfiniBand and RoCEv2, detailing their designs, flow‑control mechanisms, performance, cost and scalability characteristics, and evaluates their respective advantages and limitations to guide network selection for AI data centers.
AI computeInfiniBandRDMA
0 likes · 9 min read

This article provides a detailed comparison of InfiniBand and RoCEv2 network architectures, examining their technical features, flow‑control mechanisms, performance, cost, and suitability for AI compute environments to guide designers in selecting the optimal solution.
AI computeInfiniBandRDMA
0 likes · 9 min read

With AI models growing to billions of parameters, the choice of high‑performance interconnect—InfiniBand or RoCEv2—directly impacts training speed, scalability, latency, and operational complexity, and this article analyzes their architectures, performance metrics, vendor ecosystems, and suitability for large‑scale AI clusters.
AIHigh-Performance ComputingInfiniBand
0 likes · 13 min read

The rapid growth of AI large‑model training and inference is driving unprecedented demand for compute and high‑speed networking, prompting a shift from traditional GPU clusters to super‑pooled intelligent computing centers that must balance multiple intra‑ and inter‑node interconnect solutions such as NVLink, OAM/UBB, InfiniBand and RoCEv2.
AIInfiniBandNVLink
0 likes · 6 min read

The article examines high‑level strategies for preventing and recovering from congestion in lossless Ethernet storage networks, including disconnecting faulty devices, early frame dropping, traffic isolation, endpoint notifications, rate limiting, pause‑timeout, PFC watchdog mechanisms, detailed Cisco configuration commands, and the benefits and limitations of each approach.
Cisco NexusCongestion ManagementECN
0 likes · 33 min read

This article examines the architecture of AI compute clusters, explaining offline training and inference pipelines, the role of RDMA, and the technical differences between InfiniBand and RoCEv2—including latency, bandwidth, scalability, cost, and vendor considerations—to help engineers choose the optimal high‑performance network for large‑model training.
AI computeInfiniBandRDMA
0 likes · 13 min read

This article details the NVMe‑over‑RoCEv2 network architecture, defines plug‑and‑play and fast‑fault detection mechanisms, outlines IP domain management, LLDP and state‑notification requirements, security considerations, and provides test scenarios and tools for validating high‑performance storage networking.
LLDPNVMeRoCEv2
0 likes · 14 min read
