Designing High‑Performance Networks for Large‑Scale AI Model Training

This article examines the challenges of building scalable, low‑latency, and cost‑effective network architectures—such as Clos/Fat‑Tree, Spine‑Leaf, Dragonfly, and Torus—for massive GPU clusters used in training trillion‑parameter AI models, comparing multi‑rail and single‑rail designs and highlighting real‑world implementations from Tencent and Alibaba.

AI trainingCLOSDragonfly

0 likes · 8 min read

Designing High‑Performance Networks for Large‑Scale AI Model Training

DataFunTalk

Jul 3, 2023 · Artificial Intelligence

Exploring Large‑Scale Graph Neural Network Applications and System Optimizations at Tencent

This article reviews Tencent's research on large‑scale graph neural networks, covering three memory/computation paradigms, the SAGA extension of the GAS model, various system optimizations such as graph partitioning and feature transmission, and future challenges including non‑message‑passing models and geometric information.

System optimizationailarge-scale computing

0 likes · 14 min read

Exploring Large‑Scale Graph Neural Network Applications and System Optimizations at Tencent

DataFunSummit

Nov 19, 2022 · Operations

Large-Scale Supply Chain Inventory Optimization Using Recurrent Neural Networks

This article presents a novel approach that leverages recurrent neural network techniques and TensorFlow to dramatically accelerate simulation and optimization of massive supply‑chain networks, enabling efficient inventory positioning and safety‑stock decisions for networks with hundreds of thousands of items.

Recurrent Neural NetworkSupply ChainTensorFlow

0 likes · 13 min read

Large-Scale Supply Chain Inventory Optimization Using Recurrent Neural Networks

ByteDance Cloud Native

Nov 10, 2022 · Cloud Native

Explore ByteDance’s Cloud‑Native Journey: Key Articles and Insights

This collection highlights ByteDance’s evolution in cloud‑native technologies, covering their microservice runtime architecture, large‑scale computing practices, open‑source project creation, and container scheduling advancements, providing links to detailed articles for readers to gain deeper insight.

Microservicescloud-nativecontainer scheduling

0 likes · 1 min read

Explore ByteDance’s Cloud‑Native Journey: Key Articles and Insights