Tagged articles
GPU cluster
20 articles · Page 1 of 1
Ruijie's RG-ETH 128 supernode uses a dual compute-switch architecture with 51.2 Tb/s switch chips to scale from 64 to 128 GPUs per cabinet via Host Tray decoupling, and up to 1024 GPUs across cabinets through 32×800G expansion ports, with a roadmap from 112G copper SerDes to 224G and LPO→NPO→CPO optical interconnects.
AI supernodeGPU clusterHost Tray
0 likes · 7 min read

A developer demonstrated that a 128 GB M5 Max Mac can stream‑load the 1.6 TB MXFP4 weights of the 2.8‑trillion‑parameter Kimi K3 model, achieving 0.32 token/s, while an 80‑GPU RTX 5090 cluster reaches 20 token/s, highlighting both feasibility and speed limits of large‑model inference on consumer hardware.
GPU clusterKimi K3Mac M5 Max
0 likes · 6 min read

By decoupling VAE encoding from the main training GPU, redesigning the data flow into a fully asynchronous pipeline, and applying dynamic scheduling, multi‑level caching, and custom operators, the Cosmos3‑Nano‑Policy‑DROID system achieves a 2.1× overall throughput with only 1.5× the hardware cost, delivering roughly 35% more training throughput for the same budget.
AI InfraGPU clusterVAE Encoding
0 likes · 18 min read

The article introduces AISHPerf, the first open‑source benchmark for AI‑infra operations agents built on nearly a hundred‑billion real‑world ops records, detailing its data pipeline, multi‑layer coverage, evaluation metrics, experimental results that show current models lag behind human experts, and future plans to expand and refine the benchmark.
AI OpsEvaluation MetricsGPU cluster
0 likes · 16 min read

ZCube, a new flat networking architecture deployed by Zhipu in its GLM‑5.1 inference cluster, eliminates structural congestion, delivering a 15% throughput gain, 40.6% latency reduction, and one‑third lower hardware cost without adding GPUs, signaling a shift from raw compute to system efficiency in AI infrastructure.
AI networkingGPU clusterMRC protocol
0 likes · 15 min read


21CTOMay 7, 2026 · Industry Insights
Elon Musk dissolved xAI, rebranded it as SpaceXAI, and granted Anthropic access to the 220,000‑GPU Colossus 1 supercomputer, a move framed as a strategic strike to undermine OpenAI by leveraging massive orbital‑grade compute power.
AI supercomputingAnthropicColossus
0 likes · 12 min read

This guide walks you through installing NVIDIA drivers and Docker, configuring the NVIDIA Container Toolkit, and deploying GPUStack in Docker to manage heterogeneous GPU resources, run large language, multimodal, diffusion, and embedding models, and scale from a single node to a multi‑node GPU cluster.
AI model deploymentDockerGPU cluster
0 likes · 15 min read

This guide walks you through installing NVIDIA drivers, Docker, and the NVIDIA Container Toolkit, then shows step‑by‑step how to run GPUStack in Docker, expand a GPU cluster, and serve large language, multimodal, diffusion, and embedding models with OpenAI‑compatible APIs.
AI model deploymentDockerGPU cluster
0 likes · 15 min read

This article explains how Baidu’s Kunlun supernode, built on high‑density liquid‑cooled cabinets and a modular 1U 4‑card design, breaks traditional 8‑card limits, boosts compute density four‑fold, improves power and cooling efficiency, and provides a scalable foundation for large‑model AI training and inference.
AI infrastructureGPU clusterHigh-Performance Computing
0 likes · 13 min read

The article provides a detailed technical analysis of Huawei's CloudMatrix 384 AI supernode—its 384 Ascend 910C chips, 300 PFLOP BF16 performance, massive memory and bandwidth, power consumption, scale‑up and scale‑out optical networking, and how it compares to Nvidia's GB200 NVL72 in architecture, cost, and energy efficiency.
AI hardwareCloudMatrixGPU cluster
0 likes · 12 min read

This guide explains how to use the AIBrix distributed inference platform to deploy the massive DeepSeek‑R1 671B model across multiple GPU nodes, covering cluster setup, custom vLLM images, storage options, RDMA networking, autoscaling, request handling, and observability, turning a weeks‑long deployment into an hour‑scale process.
AIBrixDeepSeek-R1GPU cluster
0 likes · 14 min read


DevOpsNov 27, 2024 · Artificial Intelligence
The article analyzes Elon Musk’s Colossus AI supercomputer—its 100,000 NVIDIA H100 GPUs, record‑fast 122‑day construction, vertical‑integration strategy, and the broader implications for U.S. AI infrastructure dominance and China’s competing challenges in funding and chip supply.
AI infrastructureAI strategyElon Musk
0 likes · 13 min read

The article details the design and deployment of 360's AI Compute Center, covering GPU server selection, high‑performance networking, Kubernetes‑based cluster management, advanced scheduling, training and inference acceleration techniques, and a comprehensive AI development platform with visualization and fault‑tolerance features.
AI infrastructureGPU clusterKubernetes
0 likes · 21 min read

This article details the design and implementation of 360’s AI Computing Center, covering server selection, network topology, Kubernetes scheduling, training and inference acceleration, and the AI platform’s core, visualization, and fault‑tolerance capabilities for large‑scale AI workloads.
AI infrastructureGPU clusterKubernetes
0 likes · 22 min read

This article analyzes the challenges and solutions for constructing a super‑large GPU training cluster, outlining five fundamental design principles, a four‑layer plus one‑domain architecture, and practical considerations for hardware, networking, and operational reliability in AI workloads.
AI TrainingGPU clusterHigh-Performance Computing
0 likes · 8 min read

This article analyzes the architectural upgrades required for ultra‑large AI clusters, covering single‑GPU performance, super‑node scaling, DPU‑based heterogeneous computing, power‑efficiency, high‑throughput storage, and robust high‑speed networking to support trillion‑parameter model training and inference.
AIDPUGPU cluster
0 likes · 17 min read

The article details Baidu's development of a massive high‑performance GPU/IB cluster, its architectural design, the challenges of training trillion‑parameter models, and how the integrated AI stack—spanning hardware, framework, and resource management—overcomes compute, memory, and communication bottlenecks to accelerate large‑model training.
AI infrastructureBaidu AI BaseGPU cluster
0 likes · 17 min read

Baidu’s AI infrastructure combines a massive InfiniBand‑linked GPU cluster, Kunlun chips, the PaddlePaddle framework, and the Wenxin model suite with 4D hybrid parallelism, elastic fault tolerance, and a two‑stage training pipeline to overcome computation, memory, and communication walls, delivering world‑leading MLPerf performance for large‑scale LLMs.
GPU clusterInfiniBandModel Training Optimization
0 likes · 15 min read

Tencent Cloud's new HCC high‑performance computing cluster triples previous generation performance with 3.2 TB/s server bandwidth, Xingsha servers and NVIDIA H800 GPUs delivering up to 1979 TFlops, while its Xingmai 3.2 T ETH RDMA network, TB‑level storage via COS + GooseFS, and multi‑form access (bare metal, cloud servers, containers, functions) enable efficient large‑model training.
AI computingGPU clusterHigh-Performance Computing
0 likes · 9 min read

This article details Weibo's multimodal content understanding platform, covering its massive data challenges, heterogeneous model support, standardized pipelines, platformization, workflow architecture, GPU heterogeneous cluster management, resource scheduling, performance optimization, and full‑stack monitoring to achieve stable, low‑latency AI services at scale.
GPU clusterModel ServingWeibo
0 likes · 18 min read
