Tagged articles
RoCE
57 articles · Page 1 of 1
China Mobile Cloud unveils its Open Disaggregated Supernode (ODS) architecture, addressing five core challenges of traditional AI supernodes — hardware lock-in, proprietary interconnects, power/cooling limits, scale constraints, and maintenance complexity — through hardware disaggregation, open Ethernet/RoCE/FARE protocols, and optical circuit switching, achieving 50-90% power and cost reductions while enabling multi-vendor GPU clusters up to 128 cards per pod.
AI supernodeChina Mobile CloudFARE
0 likes · 6 min read


SuanNiMay 8, 2026 · Artificial Intelligence
OpenAI, together with AMD, Broadcom, Intel, Microsoft and Nvidia, introduced the Multipath Reliable Connection (MRC) protocol, which splits a single 800 Gb/s link into eight 100 Gb/s planes, enabling full‑mesh connectivity for over 100 k GPUs with fewer switches, lower cost, higher resilience, and dynamic load‑balancing that eliminates congestion and hardware‑failure impacts during large‑scale AI training.
AI networkingGPU clustersMRC
0 likes · 12 min read

This guide explains the necessity of flow control in high‑performance storage networks, details RDMA and RoCE protocols, and provides step‑by‑step commands for configuring DSCP, PFC, ECN, and related settings on servers and switches.
DSCPECNFlow Control
0 likes · 6 min read

BCG’s new “C‑Curve” framework reveals that roughly one‑seventh of listed companies suffer persistently low ROCE, and outlines a three‑step path—shrink to core, improve margins, then grow—that enables leaders to revive performance and create lasting shareholder value.
BCGC CurveCorporate Strategy
0 likes · 7 min read

This article compares the main networking technologies used in large‑scale AI GPU clusters—NVLink, InfiniBand, RoCE Ethernet, and the emerging DDC full‑schedule fabric—examining latency, lossless transmission, congestion control, cost, power and scalability to help engineers choose the optimal solution for training massive language models.
AI TrainingDDCGPU networking
0 likes · 15 min read

This article outlines the high‑performance networking requirements for AI data center training, compares InfiniBand and RoCE solutions, discusses their advantages in bandwidth, latency, scalability and cost, and provides design guidelines for building scalable, low‑latency, non‑blocking AI‑centric network architectures.
AIHigh-Performance ComputingInfiniBand
0 likes · 10 min read

Tencent’s Star‑Network team partnered with DeepSeek to open‑source the DeepEP communication library, then used its self‑developed TRMT stack to overcome RoCE limitations, achieving up to 100% speedup on RoCEv2 and 30% on InfiniBand, cutting training costs and inference latency for large MoE models.
AI TrainingDeepEPDeepSeek
0 likes · 8 min read

The whitepaper explains that AI model training and inference rely on massive data computation, with model sizes reaching billions of parameters, demanding low‑latency, high‑bandwidth, stable, scalable, and manageable networks; it compares RDMA‑based InfiniBand and RoCE solutions and offers design recommendations for future AI compute clusters.
AIInfiniBandRDMA
0 likes · 10 min read

This article provides a comprehensive technical analysis of InfiniBand architecture, its protocol stack, comparison with Ethernet‑based RDMA solutions like RoCE and iWARP, and an overview of Omni‑Path, highlighting performance advantages, design trade‑offs, and practical limitations.
High-Performance ComputingInfiniBandOmni‑Path
0 likes · 19 min read

DeepSeek engineers highlighted Tencent’s open‑source TRMT and DeepEP contributions that boost GPU‑to‑GPU communication by up to 300%, double RoCE performance and add a further 30% gain on InfiniBand, while addressing lane‑utilization and CPU‑control bottlenecks through three targeted optimizations.
DeepEPDeepSeekGPU communication
0 likes · 6 min read

Tencent engineers highlighted a massive speedup in DeepSeek’s open‑source DeepEP communication framework, revealing how their TRMT‑based optimizations—dynamic multi‑QP topology awareness, IBGDA‑driven CPU‑bypass, and atomic signaling—boost RoCE network throughput up to 300% and add another 30% gain when applied to InfiniBand, effectively doubling GPU communication performance for large AI models.
AI model trainingDeepEPGPU communication
0 likes · 8 min read

This article analyzes how the traditional OSI/TCP‑IP model is giving way to RDMA in high‑performance computing, compares Ethernet, InfiniBand and RoCE, evaluates leaf‑spine versus three‑tier data‑center designs, and examines NVIDIA SuperPOD architectures with detailed technical metrics.
HPCInfiniBandLeaf-Spine
0 likes · 14 min read

AI large‑model training relies on GPU clusters, generating massive inter‑node traffic that turns network performance into the primary bottleneck, prompting a detailed comparison of InfiniBand and RoCE protocols, their histories, strengths, limitations, and the need for next‑generation network chip architectures.
AIHPCInfiniBand
0 likes · 5 min read

This article examines the evolution from the OSI and TCP/IP models to RDMA‑based technologies, compares traditional three‑tier and leaf‑spine architectures, analyzes NVIDIA SuperPOD designs, and evaluates Ethernet, InfiniBand, and RoCE switches to guide high‑throughput, low‑latency data‑center networking decisions.
High-Performance ComputingInfiniBandLeaf-Spine
0 likes · 13 min read

The article surveys the network architectures and congestion‑control techniques used in massive GPU clusters—such as Byte’s megascale, Baidu HPN, Alibaba HPN7, and Tencent Xingmai 2.0—highlighting how high‑bandwidth, low‑latency designs and advanced RDMA technologies enable training of trillion‑parameter multimodal AI models.
GPU clustersHPNInfiniBand
0 likes · 11 min read

The article explains how RDMA technologies—including InfiniBand, RoCE, and iWARP—provide high‑throughput, low‑latency, CPU‑free data transfer for massive generative AI model training, compares their architectures, and discusses modern network designs and load‑balancing strategies to optimize AI‑focused data‑center networks.
AI TrainingHigh‑Performance ComputingInfiniBand
0 likes · 11 min read

The article analyzes how the rapid shift of data‑center spending toward AI/ML has accelerated RDMA and RoCE adoption, outlines market forecasts through 2028, explains the technical advantages of direct memory access, and examines the evolving server, NIC, and backend‑network landscapes that will shape future AI workloads.
AI/MLRDMARoCE
0 likes · 12 min read

The article explains how RDMA and RoCE technologies, originally built for high‑performance computing, are rapidly expanding in AI/ML data centers, driving massive market growth, faster GPU communication, and lower job completion times as server designs evolve toward higher GPU counts and faster NICs.
AI/MLRDMARoCE
0 likes · 10 min read

The article analyzes the networking challenges of AI super‑large models, comparing InfiniBand and RoCE technologies, and presents design guidelines for ultra‑scale, high‑bandwidth, low‑latency, and highly stable cluster interconnects to maximize GPU utilization and overall training efficiency.
AIGPU interconnectHigh‑Performance Computing
0 likes · 14 min read

This article reviews the main GPU/TPU cluster networking solutions—including NVLink, InfiniBand, RoCE Ethernet, and DDC full‑schedule fabrics—examining their latency, loss‑free transmission, congestion control, cost, scalability, and suitability for large‑scale LLM training workloads.
AI TrainingDDCGPU networking
0 likes · 16 min read

The article analyzes how AI‑driven elephant flows overload traditional Ethernet networks, causing long‑tail latency and victim‑flow congestion, and explains how adaptive routing, RDMA/ RoCE features, advanced congestion‑control algorithms, and high‑capacity switch chips can mitigate these challenges.
AI computingAdaptive routingElephant flow
0 likes · 7 min read

The article examines the rise of the Ultra Ethernet Consortium (UEC), its new specifications, and how industry leaders like Broadcom, Nvidia, and Meta are shifting from InfiniBand to RoCE to meet the high‑throughput, low‑latency demands of AI and HPC workloads, highlighting technical advantages and future trends.
EthernetHPCInfiniBand
0 likes · 8 min read

This article analyzes traditional cloud data center network limitations for AI workloads and compares various high‑bandwidth, low‑latency architectures—including two‑layer and three‑layer fat‑tree designs, InfiniBand, and RoCE—providing best‑practice recommendations for building scalable, non‑blocking AI‑Pool networks.
AI computingFat-TreeGPU clusters
0 likes · 12 min read

The article provides a detailed technical analysis of RoCE (RDMA over Converged Ethernet), its two protocol versions, packet overhead, congestion‑control mechanisms, Soft‑RoCE implementation, and the challenges and performance implications of deploying RoCE in modern HPC environments compared to InfiniBand and traditional Ethernet solutions.
HPCInfiniBandRDMA
0 likes · 17 min read

This article explains how to construct high‑performance RoCE v2 and InfiniBand networks within a cloud‑native Kubernetes environment, detailing the underlying technologies, required components, configuration steps, and performance test results that demonstrate significant communication speed improvements for large‑scale AI model training.
AI TrainingInfiniBandKubernetes
0 likes · 12 min read

This article analyzes the main GPU/TPU cluster networking options—NVLink, InfiniBand, RoCE Ethernet, and DDC full‑schedule fabrics—examining latency, lossless transmission, congestion control, cost, power, and scalability to determine their suitability for large‑scale LLM training.
DDCData center fabricsGPU networking
0 likes · 18 min read

This article explains how Remote Direct Memory Access (RDMA) technologies such as InfiniBand and RoCE bypass OS kernels to achieve ultra‑low latency and high bandwidth, discusses their hardware implementations, cost considerations, and their critical impact on large‑scale AI model training and HPC network design.
AIGPUHigh‑Performance Computing
0 likes · 11 min read

The article reviews ten years of RDMA development, tracing its origins, the rise and pitfalls of RoCEv1/v2, alternative approaches like iWARP and Cisco usNIC, and recent modernizations such as AWS SRD, Google Falcon and UltraEthernet, highlighting why protocol design choices have repeatedly stalled industry progress.
AI AcceleratorsProtocol DesignRDMA
0 likes · 27 min read

This article examines the key GPU/TPU cluster networking options—NVLink, InfiniBand, RoCE Ethernet, and emerging DDC full‑scheduling fabrics—detailing their latency, loss‑less transmission, congestion control, cost, power, and scalability considerations for large‑scale AI training deployments.
AI TrainingDDC fabricGPU networking
0 likes · 18 min read

This article examines the main GPU/TPU cluster networking options—including NVLink, InfiniBand, RoCE Ethernet Fabric, and DDC full‑schedule networks—explaining their latency, loss‑less transmission, congestion control, cost, scalability, and suitability for large‑scale LLM training workloads.
GPU networkingInfiniBandLLM training
0 likes · 18 min read

This article explains the differences between RDMA (including RoCE, InfiniBand, and iWARP) and traditional TCP/IP, describes the three main RDMA network types, compares their characteristics, and outlines their typical usage in distributed storage environments.
InfiniBandRDMARoCE
0 likes · 7 min read

This article explains the principles of DMA and RDMA, compares RDMA protocols such as InfiniBand, RoCE, and iWARP, outlines their performance advantages, and reviews the key standards bodies, open‑source communities, hardware vendors, and real‑world adoption in high‑performance data centers.
DMAHigh-Performance ComputingInfiniBand
0 likes · 15 min read

This article examines the RoCE protocol—an RDMA‑enabled Ethernet technology—its evolution, technical details, congestion‑control mechanisms, performance comparisons with InfiniBand, practical deployment issues in HPC clusters, and real‑world case studies such as Slingshot and application benchmarks.
EthernetHPCRDMA
0 likes · 19 min read

The article explains how hyper‑converged, lossless Ethernet networks integrate storage, high‑performance and general‑purpose compute zones, improve computational efficiency (CE) by reducing latency and power consumption, and outlines emerging technologies such as RoCE, NVMe‑over‑Fabric, PCIe‑free CPU/GPU designs, IPv6 deployment, and AI‑driven traffic management for modern data centers.
Computational EfficiencyHyper-ConvergedNVMe over Fabrics
0 likes · 11 min read

This article examines the RoCE protocol, its evolution and variants, lossless networking and congestion‑control mechanisms, practical performance measurements on HPC clusters, and the advantages and limitations of deploying RoCE in high‑performance computing environments.
EthernetHPCRDMA
0 likes · 18 min read

This article provides an overview of InfiniBand and Remote Direct Memory Access (RDMA), explains their underlying protocols and hardware, and offers detailed step‑by‑step guidance for configuring InfiniBand, RDMA, RoCE, and related services on Red Hat Enterprise Linux systems.
InfiniBandLinuxRDMA
0 likes · 9 min read

This article examines the RoCE protocol and its use in high‑performance computing, describing its low‑latency advantages, congestion‑control mechanisms, performance comparisons with InfiniBand, practical deployment issues, and real‑world case studies such as Slingshot and CESM/GROMACS benchmarks.
EthernetHPCRDMA
0 likes · 18 min read

The article analyzes how the shift of data centers toward compute-centric architectures drives the need for high‑performance networking, explains the shortcomings of TCP/IP, compares InfiniBand, iWarp and RoCE protocols, and shows why loss‑less Ethernet with RDMA is critical for modern HPC workloads.
HPCInfiniBandRDMA
0 likes · 12 min read

This article explains the fundamentals of Remote Direct Memory Access (RDMA), comparing it with traditional networking, outlining its core advantages, suitable use cases, the three main RDMA protocols (Infiniband, RoCE, iWARP), deployment requirements, communication flow, and essential programming concepts.
RDMARoCEhigh performance networking
0 likes · 9 min read

The article explains how high‑performance computing (HPC) networks overcome TCP/IP limitations by using RDMA‑based technologies such as RoCE v1/v2 and InfiniBand, detailing their architectures, advantages, vendor implementations, and cost‑effective migration to Ethernet‑based solutions for GPU‑driven workloads.
HPCHighPerformanceComputingInfiniBand
0 likes · 7 min read

This guide explains the fundamentals of InfiniBand and RDMA, details the InfiniBand Verbs API, outlines the steps required for kernel data handling, and provides practical configuration instructions for RoCE, IPoIB, and the subnet manager on Red Hat Enterprise Linux 8.
IPoIBInfiniBandRDMA
0 likes · 11 min read

The article explains how the rise of all‑flash data centers has driven the adoption of NVMe storage protocols, compares NVMe‑over‑FC, TCP, and RoCE, highlights RoCE’s performance and reliability advantages, and details Huawei’s NoF+ solution that enhances network performance, reliability, and ease of use for modern storage networks.
Data Center StorageHuaweiNVMe over Fabrics
0 likes · 11 min read

The article analyzes how hyper‑converged data center networks use lossless Ethernet to unify general compute, high‑performance computing and storage, enabling lifecycle automation, intelligent operation, and significant compute capacity gains without expanding server count.
ComputeEthernetHyper-Converged
0 likes · 14 min read

The article explains how modern data‑center compute demands drive the need for high‑throughput, low‑latency networking, compares TCP/IP with RDMA‑based solutions such as InfiniBand, iWARP and RoCE, and recommends loss‑less Ethernet for large‑scale HPC deployments.
HPCInfiniBandRDMA
0 likes · 10 min read

This article explains the concepts of Direct Memory Access (DMA) and Remote Direct Memory Access (RDMA), compares traditional data transfer with DMA-enabled paths, outlines RDMA's advantages such as zero-copy and kernel bypass, and reviews the main RDMA protocols, standards bodies, and hardware ecosystem.
DMAHigh-Performance ComputingRDMA
0 likes · 14 min read

This article explains Remote Direct Memory Access (RDMA), its origins in InfiniBand, the Ethernet‑based variants iWARP and RoCE (including RoCEv1 and RoCEv2), compares their architectures, performance characteristics, and deployment requirements for high‑performance computing and data‑center networks.
InfiniBandRDMARoCE
0 likes · 11 min read

This article explains the fundamentals of RDMA and RoCE, compares RoCE v1 and v2, outlines deployment steps, highlights performance benefits such as low CPU usage and zero‑copy, and answers common questions about its differences from iWARP and InfiniBand, helping data‑center engineers evaluate the technology.
EthernetHigh BandwidthRDMA
0 likes · 8 min read

RoCE (RDMA over Converged Ethernet) enables lossless, high‑performance data transfer in data‑center networks by extending InfiniBand over Ethernet, with RoCEv1 operating at Layer 2, RoCEv2 adding UDP/IPv4/IPv6 routing, and Soft‑RoCE providing a software‑only solution for environments lacking RDMA‑capable hardware.
EthernetNetworkingRDMA
0 likes · 8 min read

This article explains how to design a low‑overhead, high‑performance lossless RoCE network for data centers, covering RDMA basics, mainstream network options, QoS, lossless and congestion‑control designs, buffer management, deadlock analysis, and practical tuning to achieve sub‑100 µs latency and near‑full bandwidth utilization.
Lossless EthernetQoSRDMA
0 likes · 21 min read

This article examines the rise of RDMA high‑performance networking, explains its technical advantages over traditional TCP/IP, showcases real‑world deployments in machine learning at Baidu, and explores future use cases in storage, GPU communication, and core services.
GPU DirectInfiniBandRDMA
0 likes · 9 min read

This article explains how RDMA (Remote Direct Memory Access) technology, originating from InfiniBand and extended to Ethernet (RoCE) and TCP/IP (iWARP), provides ultra‑low latency, high throughput, and minimal CPU usage for high‑performance computing and big‑data applications by bypassing traditional OS and protocol stack processing.
RDMARoCEhigh performance networking
0 likes · 8 min read

The article explains the background, architecture, and performance advantages of RDMA high‑performance networking, compares it with traditional TCP/IP, describes its deployment at Baidu for machine‑learning workloads, and outlines future use cases such as storage acceleration, GPU communication, and core services.
RDMARoCEhigh performance networking
0 likes · 12 min read

The article examines how NVMe‑over‑Fabric extends NVMe beyond PCIe using various fabrics—FC, InfiniBand, RoCE v2, iWARP and TCP—highlighting RDMA’s zero‑copy, kernel‑bypass and CPU‑free advantages, and comparing protocol differences, performance trade‑offs, and the evolution toward NVMe/TCP.
Fibre ChannelInfiniBandNVMe
0 likes · 13 min read

The article provides a comprehensive overview of Remote Direct Memory Access (RDMA), explaining its underlying principles, performance advantages over traditional TCP/IP, various protocol families such as InfiniBand, RoCE, and iWARP, and practical implementation considerations for high‑performance networking.
High-Performance ComputingRDMARoCE
0 likes · 12 min read

This article provides a comprehensive overview of Remote Direct Memory Access (RDMA), detailing its underlying principles, performance advantages over traditional TCP/IP, various protocol families such as InfiniBand, RoCE, and iWARP, and their respective hardware and software requirements.
High-Performance ComputingInfiniBandRDMA
0 likes · 9 min read

The article provides a comprehensive overview of RDMA technology, explaining its low‑latency, high‑throughput benefits, origins in InfiniBand, extensions like RoCE and iWARP, the Verbs API, communication models, and why it is poised for broader adoption in modern networking and storage systems.
RDMARoCEhigh-throughput
0 likes · 9 min read

Remote Direct Memory Access (RDMA) is a high‑performance networking technology that moves data directly between the memories of two computers without OS involvement, offering low latency, zero‑copy transfers and reduced CPU load through protocols such as InfiniBand, RoCE and iWARP.
InfiniBandRDMARoCE
0 likes · 9 min read
