Tagged articles
high performance networking
32 articles · Page 1 of 1
The article explains why Netty outperforms raw JDK NIO for network programming by detailing NIO's pain points, Netty's elegant Reactor design, zero‑copy and memory‑pool optimizations, built‑in codecs and pipeline, bug fixes, and its extensive ecosystem, all framed as interview knowledge.
ChannelPipelineJava NIONetty
0 likes · 14 min read

Feat achieves sub‑100 ms startup, double Vert.x throughput, and sub‑1 ms latency because its communication layer relies on the ultra‑lightweight smart‑socket kernel, a 2,000‑line AIO implementation that eliminates unnecessary abstraction and resource waste.
Feat frameworkJava AIOasync I/O
0 likes · 6 min read

Go 1.26 introduces context‑aware net.Dialer methods that combine the zero‑overhead speed of net.DialTCP with timeout, cancellation and tracing capabilities, eliminating DNS resolution and protocol dispatch overhead while providing clear code and a 10‑15% latency reduction for high‑frequency short connections.
ContextGoUnix socket
0 likes · 8 min read

This article explains how traditional kernel network stacks struggle with modern cloud data‑center workloads and introduces Baidu Intelligent Cloud's Polar solution—Polar‑TCP and Polar‑RDMA—which combine user‑space DPDK drivers, a lightweight TCP stack, and an industrial‑grade RPC framework to achieve near‑RDMA performance while preserving ecosystem compatibility.
DPDKRDMAcloud computing
0 likes · 24 min read

This article explains how InfiniBand’s architecture, native RDMA, GPUDirect, and evolving bandwidth enable ultra‑low‑latency, high‑throughput communication for AI model training, compares it with Ethernet, and details the role of RoCEv2 and other high‑performance interconnect technologies.
AI TrainingGPU interconnectInfiniBand
0 likes · 9 min read

UALink is an open, high‑performance interconnect standard designed to link thousands of AI accelerators, offering NVLink‑level bandwidth, low latency, scalability, cost efficiency, and flexible topologies to meet the demanding communication needs of modern AI workloads.
AI interconnectProtocol StackUALink
0 likes · 8 min read

The whitepaper explains that AI model training and inference rely on massive data computation, with model sizes reaching billions of parameters, demanding low‑latency, high‑bandwidth, stable, scalable, and manageable networks; it compares RDMA‑based InfiniBand and RoCE solutions and offers design recommendations for future AI compute clusters.
AIInfiniBandRDMA
0 likes · 10 min read

The article provides a detailed, step‑by‑step tour of xAI’s Colossus supercomputer— a $‑billion AI cluster built in 122 days with 100,000 NVIDIA H100 GPUs—covering Supermicro liquid‑cooled 4U racks, cooling distribution units, power and water infrastructure, storage nodes, CPU servers, 400 GbE networking, and the operational challenges of scaling such a massive system.
AI supercomputingColossusNVIDIA H100
0 likes · 16 min read

The article details Baidu Baige 4.0’s four‑layer AI infrastructure—hardware, cluster components, training‑inference acceleration, and platform tools—highlighting its heterogeneous computing, high‑performance networking, fault‑tolerant communication library, and optimizations that boost large‑model training and inference efficiency.
AI infrastructureheterogeneous computinghigh performance networking
0 likes · 17 min read

This article analyzes the technical roadmap for upgrading AI super‑large GPU clusters to support trillion‑parameter multimodal models, covering single‑chip performance, super‑node scaling, DPU‑based compute fusion, energy‑efficient designs, converged storage, high‑throughput networking, and fault‑tolerant checkpoint strategies.
AI computeDPUGPU clusters
0 likes · 18 min read

The article surveys the network architectures and congestion‑control techniques used in massive GPU clusters—such as Byte’s megascale, Baidu HPN, Alibaba HPN7, and Tencent Xingmai 2.0—highlighting how high‑bandwidth, low‑latency designs and advanced RDMA technologies enable training of trillion‑parameter multimodal AI models.
GPU clustersHPNInfiniBand
0 likes · 11 min read

This article analyzes traditional cloud data center network limitations for AI workloads and compares various high‑bandwidth, low‑latency architectures—including two‑layer and three‑layer fat‑tree designs, InfiniBand, and RoCE—providing best‑practice recommendations for building scalable, non‑blocking AI‑Pool networks.
AI computingFat-TreeGPU clusters
0 likes · 12 min read

This article examines the integration of Linux io_uring into ByteDance's high‑performance Netpoll NIO library, detailing architectural changes, receive/send workflows, benchmarking methodology, and results that show over 10% higher throughput and 20‑40% lower latency while eliminating system calls.
Gobenchmarkhigh performance networking
0 likes · 18 min read

This article explains how to construct high‑performance RoCE v2 and InfiniBand networks within a cloud‑native Kubernetes environment, detailing the underlying technologies, required components, configuration steps, and performance test results that demonstrate significant communication speed improvements for large‑scale AI model training.
AI TrainingInfiniBandKubernetes
0 likes · 12 min read

This article provides a detailed technical comparison between InfiniBand and RoCE v2, covering architecture, lossless transmission, adaptive routing, major vendors, performance, scalability, operational complexity, and cost considerations to help AI data center architects select the most suitable high‑performance network solution.
AI data centerInfiniBandNetwork Comparison
0 likes · 13 min read

The talk examines the challenges of using standard Linux TCP for high‑performance data‑center workloads, explores how RDMA can provide zero‑copy and asynchronous kernel bypass, and presents experimental results from an FPGA‑based prototype that approaches 800 Gbps packet rates while highlighting congestion‑control and CPU‑utilization trade‑offs.
FPGARDMAcongestion control
0 likes · 23 min read

This article explains the origins of DPDK, describes its modular architecture and performance‑enhancing mechanisms such as UIO, hugepages, and CPU affinity, and reviews popular user‑space networking frameworks like F‑Stack and Seastar that leverage DPDK for high‑throughput cloud services.
DPDKF-StackUser-space I/O
0 likes · 9 min read

In a detailed interview at the 2023 Wuzhen Internet Forum, Alibaba Cloud’s infrastructure lead Cai Dezhong outlines the three‑phase IPv6 rollout, highlights organizational and technical innovations, stresses the need for global cooperation, and explains how IPv6 underpins the next generation AI infrastructure and predictable high‑performance networking.
AI infrastructureGlobal CollaborationIPv6
0 likes · 9 min read

The 2023 Open Data Center Conference in Beijing showcased Alibaba Cloud's AI‑era infrastructure innovations—including high‑density compute clusters, predictable high‑performance networking, intelligent power‑simulation systems, battery diagnostics, liquid‑cooling solutions, and modular server standards—demonstrating how cloud platforms are being rebuilt to meet the demands of large AI models and sustainable operation.
AIIntelligent OperationsModular Servers
0 likes · 10 min read

This article examines the architecture of AI compute clusters, explaining offline training and inference pipelines, the role of RDMA, and the technical differences between InfiniBand and RoCEv2—including latency, bandwidth, scalability, cost, and vendor considerations—to help engineers choose the optimal high‑performance network for large‑model training.
AI computeInfiniBandRDMA
0 likes · 13 min read

This article explains the design and engineering of Baidu's AIPod high‑performance network, detailing the massive bandwidth, scalability, stability, and low‑latency requirements of large‑scale AI model training and the practical tools used to monitor and troubleshoot such workloads.
AIAIPoddistributed training
0 likes · 22 min read

This article examines the challenges of scaling AI model training beyond single-chip limits, introduces Alibaba Cloud’s Predictable Network architecture—including high‑performance Ethernet, dual‑uplink, and adaptive routing—and compares its performance, scalability, and reliability against InfiniBand, showing how Ethernet can meet AI workloads with minimal loss.
AI TrainingEthernet vs InfiniBandPredictable Network
0 likes · 27 min read

HARP is Tencent Cloud's high-performance, highly available network transmission protocol that quickly reroutes around switch failures within 100 µs, offering zero packet loss, low latency, high bandwidth, scalable connections, and custom congestion control for storage, HPC, AI, and big data workloads.
HARPcongestion controldata center
0 likes · 15 min read

The article reviews high‑performance networking options—RDMA (including RoCE v2 and iWARP) and Linux’s io_uring—explaining their principles, hardware requirements, and benchmark results, and concludes that while RDMA delivers ultra‑low latency for specialized workloads, io_uring offers modest network benefits, leaving TCP as the default for most services.
RDMAbenchmarkhigh performance networking
0 likes · 10 min read

This article explains the fundamentals of Remote Direct Memory Access (RDMA), comparing it with traditional networking, outlining its core advantages, suitable use cases, the three main RDMA protocols (Infiniband, RoCE, iWARP), deployment requirements, communication flow, and essential programming concepts.
RDMARoCEhigh performance networking
0 likes · 9 min read

This article explains Remote Direct Memory Access (RDMA), its origins in InfiniBand, the Ethernet‑based variants iWARP and RoCE (including RoCEv1 and RoCEv2), compares their architectures, performance characteristics, and deployment requirements for high‑performance computing and data‑center networks.
InfiniBandRDMARoCE
0 likes · 11 min read

This article explains the core principles of DPDK memory management, covering standard huge pages, NUMA node binding, direct memory access, IOMMU and IOVA addressing, custom allocators, and memory pools, and how these mechanisms together enable high‑performance packet processing on Linux systems.
DMADPDKIOMMU
0 likes · 14 min read

The 2019 Yunqi Conference Cloud Network Forum gathered over two hundred network enthusiasts to review a decade of Alibaba data‑center networking evolution, explore emerging technologies such as AI, big data, and programmable chips, and outline the next ten years of high‑performance, data‑centric cloud networking.
big datahigh performance networkingnetwork architecture
0 likes · 9 min read

This article provides an in‑depth technical overview of DPDK and SPDK, covering their background, the evolution of network I/O, Linux bottlenecks, user‑space I/O via UIO, poll‑mode drivers, performance‑optimizing techniques such as huge pages, SIMD, cache management, and the surrounding ecosystem and adoption.
DPDKSPDKUser-space I/O
0 likes · 15 min read

This article examines the rise of RDMA high‑performance networking, explains its technical advantages over traditional TCP/IP, showcases real‑world deployments in machine learning at Baidu, and explores future use cases in storage, GPU communication, and core services.
GPU DirectInfiniBandRDMA
0 likes · 9 min read

This article explains how RDMA (Remote Direct Memory Access) technology, originating from InfiniBand and extended to Ethernet (RoCE) and TCP/IP (iWARP), provides ultra‑low latency, high throughput, and minimal CPU usage for high‑performance computing and big‑data applications by bypassing traditional OS and protocol stack processing.
RDMARoCEhigh performance networking
0 likes · 8 min read

The article explains the background, architecture, and performance advantages of RDMA high‑performance networking, compares it with traditional TCP/IP, describes its deployment at Baidu for machine‑learning workloads, and outlines future use cases such as storage acceleration, GPU communication, and core services.
RDMARoCEhigh performance networking
0 likes · 12 min read
