This article provides a comprehensive overview of InfiniBand technology, covering its history, architecture, packet structure, layer hierarchy, switching mechanisms, and performance advantages over Ethernet, highlighting its role as a low‑latency, high‑bandwidth solution for high‑performance computing.
Alibaba Cloud's PAI platform and Shanghai Jiao Tong University’s team announced their ASPLOS 2023‑accepted paper uGrapher, which unifies graph operator computation for GNNs, achieving up to 3.5× speedup over existing frameworks and paving the way for industrial‑scale acceleration.
This article provides an in‑depth examination of InfiniBand, covering its rapid development as a high‑bandwidth, low‑latency interconnect technology, the InfiniBand Trade Association, detailed packet structures, layered architecture, switching mechanisms, and a comparative analysis with Ethernet, highlighting its advantages for high‑performance computing.
The article provides a detailed technical overview of Huawei's Kunpeng 920 processor, describing its ARM‑based RISC architecture, chip organization, core and cache hierarchy, security features, IMU management, and the design of its I/O, interrupt, network, SAS, and PCIe subsystems.
This article demonstrates how importing the Taichi library into Python can dramatically accelerate compute‑intensive tasks, showcasing prime counting, longest common subsequence, and reaction‑diffusion simulations with speedups up to 120× and GPU support, while providing installation and usage guidance.
Jack Dongarra, a pioneering computer scientist, created the Linpack library and benchmark that enabled software to scale from laptops to exaflop supercomputers, earning him the 2022 ACM A.M. Turing Award and shaping modern high‑performance and cloud computing.
The article presents high_service, a high‑performance inference framework that boosts GPU utilization in multimedia AI services by separating CPU‑heavy preprocessing from GPU inference, employing priority‑based auto‑scaling, multi‑tenant sharing, and TensorRT‑accelerated models to eliminate GIL bottlenecks, reduce waste, and adapt to fluctuating traffic, with future work targeting automated bottleneck detection and further CPU‑GPU offloading.
Auto ScalingGPU utilizationHigh-Performance Computing
Distributed storage encompasses integrated appliances and pure‑software solutions, each with distinct hardware strategies, and forms a multi‑dimensional industry ecosystem that spans commercial and open‑source software, specialized and generic hardware, serving critical scenarios such as virtualization/cloud, high‑performance computing, and big‑data analytics.
This article provides a comprehensive overview of low‑latency architecture, covering network hardware, system‑level programming strategies, language choices, memory management techniques, event‑driven designs, high‑performance data structures, and visualization approaches for building ultra‑fast computing systems.
This article explains the concept of computing power, traces its evolution from early mechanical tools to modern cloud and AI accelerators, classifies its types, discusses measurement units, and examines current global trends and future challenges for this critical digital resource.
This article explains the storage problems faced by traditional HPC, AI‑driven HPC and high‑performance data analysis, describes Baidu's internal high‑performance storage practices, and introduces the Baidu Canghai solution—including object storage BOS, parallel file system PFS, RapidFS, data‑flow mechanisms and a customer case—demonstrating how these technologies meet the demanding throughput, latency and cost requirements of modern high‑performance workloads.
This article analyzes the storage challenges of high‑performance computing—including traditional HPC, AI‑driven HPC, and high‑performance data analysis—examines Baidu’s internal practices, and presents the Canghai storage platform with its object storage, parallel file system (PFS) and RapidFS solutions that address throughput, latency, and scalability requirements.
AI TrainingHigh-Performance Computingcloud storage
This article explains the fundamentals of high‑performance computing, covering serial and parallel processing, heterogeneous CPU‑GPU architectures, FLOPS measurement levels, key terminology, and why HPC is essential for scientific and engineering simulations, while also noting market reports and resource links.
The ORNL Frontier supercomputer has shattered the TOP500 record by achieving over one exaflop of performance, featuring AMD CPUs and GPUs, massive storage, high energy efficiency, and marking a pivotal shift in global high‑performance computing rankings.
This article explains Intel Omni-Path Architecture and InfiniBand, describing their protocol stack, network topology, RDMA technology, and related protocols such as RoCE and iWARP, while also comparing their design goals and performance characteristics.
This article provides a comprehensive overview of high‑performance computing (HPC), covering its definition, hardware architectures, performance metrics, cluster components, parallel file systems, management and scheduling tools, as well as common MPI implementations and links to further technical resources.
This guide explains what a server is, outlines its key hardware components, and reviews the essential software and applications that run on servers, providing a comprehensive overview for anyone interested in high‑performance computing systems.
This article explains the fundamentals of high‑performance computing (HPC), covering its serial and parallel processing models, CPU and GPU roles, heterogeneous architectures, FLOPS performance metrics, market trends, and key terminology needed to grasp why HPC is essential for scientific and engineering simulations.
This article explains the fundamentals of high‑performance computing (HPC), covering serial and parallel processing, CPU vs GPU roles, heterogeneous architectures, FLOPS performance metrics, system design challenges, and why HPC is essential for large‑scale scientific and engineering simulations.
This article provides a comprehensive overview of Remote Direct Memory Access (RDMA), covering its definition, how it differs from traditional networking, core advantages such as zero‑copy and CPU offload, typical use cases, the three main RDMA protocols, deployment requirements, and essential programming concepts and terminology.
The article examines bus‑level data center network technologies, detailing how RDMA and ultra‑low‑latency forwarding mechanisms reduce end‑to‑end delays, enable high‑performance computing and AI workloads, and drive the evolution toward hyper‑converged, cloud‑native infrastructures.
This article explains the fundamentals of high‑performance computing, covering its serial and parallel processing models, heterogeneous CPU‑GPU architectures, performance measurement in FLOPS, the scale needed for exaFLOPS systems, key terminology, and why HPC is essential for scientific and engineering challenges.
The article outlines major trends influencing high‑performance computing, including AI integration, GPU/TPU advancements, flexibility in processor architectures, HPC‑as‑a‑Service, hybrid cloud solutions, democratization, the emergence of exascale systems, and micro‑architectural improvements, while providing links to related reports and resources.
The article examines Fujitsu’s A64FX ARM‑compatible processor, detailing its 7 nm FinFET design, HBM2 memory, SVE vector extensions, and system‑on‑chip integration, while comparing its engineering philosophy and performance to IBM’s BlueGene/L and explaining how these choices enabled the Fugaku supercomputer to top the Top500 list.
The HPC Cloud whitepaper released by the Supercomputing Innovation Alliance defines high‑performance computing cloud concepts, outlines three product models, presents a reference architecture with layered services, and provides market forecasts and application scenarios for the emerging HPC‑cloud ecosystem.
This article introduces Linux cluster fundamentals, explains key concepts such as scalability, high availability, load balancing, and error recovery, categorizes clusters into high‑availability, load‑balancing, and high‑performance types, and outlines common architectures, technologies, and implementation methods for building robust, fault‑tolerant systems.
The article provides a comprehensive technical overview of InfiniBand, covering its history, standards, architecture layers, packet format, performance advantages, and a detailed comparison with Ethernet, highlighting why it has become the preferred high‑speed interconnect for HPC workloads.
As data volumes explode, Intel’s open‑source Distributed Asynchronous Object Storage (DAOS) offers a low‑latency, high‑bandwidth, NVM‑optimized platform that bridges the gap between high‑performance computing, big data analytics, and artificial intelligence workloads.
The article examines how electrification, intelligence, connectivity and sharing drive new autonomous‑driving requirements, detailing challenges in vehicle platform architecture, sensor technologies (camera, lidar, radar), high‑performance computing, integration, and rigorous test validation needed to achieve pre‑installed mass‑production autonomous vehicles.
This article provides a comprehensive overview of IBM's General Parallel File System (GPFS), detailing its historical development, architectural models—including SAN, NSD, and Share‑Nothing Cluster—its operational capabilities, performance advantages, scalability, high‑availability features, and its role in large‑scale high‑performance computing environments.
This article explains the fundamentals of NFS, introduces the advanced pNFS architecture with its three protocols, compares storage layouts, and discusses performance benefits and real‑world deployments in high‑performance computing environments.
The article analyzes China's GPGPU market, explaining the technology, current applications, rapid growth forecasts, supply‑side concentration, policy support, and the urgent need for domestic alternatives to meet soaring AI and high‑performance computing demand.
An in‑depth look at bare metal servers explains how they differ from virtualized cloud instances, why they’re needed for performance‑critical or security‑sensitive workloads, their integration with cloud services, and market trends driving their growing adoption.
Bare Metal ServerHigh-Performance Computingcloud computing
The article explains how modern weather forecasting in China combines traditional observations with artificial‑intelligence techniques such as U‑Net image‑to‑image models, optical‑flow analysis, and massive high‑performance computing to improve precipitation nowcasting, while also highlighting the scientific challenges and interdisciplinary nature of meteorology.
On June 22, 2020, Japan's Fugaku supercomputer, built with Fujitsu's ARM‑based A64FX processors, claimed the top spot in all four TOP500 benchmarks, delivering 415.5 petaflops in Linpack and dramatically surpassing rivals while highlighting the growing impact of ARM architecture in high‑performance computing.
This article explains how InfiniBand’s RDMA‑based architecture, layered protocol stack, and Mellanox Socket Direct technology deliver far higher bandwidth, lower latency, and better CPU efficiency than traditional TCP/IP networks, and it presents performance test results that show up to an 80% latency reduction.
This article explains how Alibaba Cloud's E‑HPC supercomputing platform provides the massive compute power needed for rapid virus research and high‑throughput drug screening, detailing the workflow, required resources, and practical code examples for parallel processing in the fight against COVID‑19.
Taichi, a Python‑embedded DSL created by an MIT PhD, dramatically speeds up material point method simulations—achieving up to 188× faster than TensorFlow—while keeping code concise, enabling differentiable physics for graphics and AI research.
Differentiable ProgrammingHigh-Performance ComputingMaterial Point Method
The 54th TOP500 list released in November 2019 shows China and the United States still dominate in both the number and performance of supercomputers, with the total HPL performance reaching 1.65 exaflops and the entry threshold rising to 1.14 petaflops.
This article explains the fundamentals of parallel and distributed computing, their definitions, core principles, advantages, required conditions, and key differences, highlighting how each approach tackles large‑scale tasks within high‑performance computing environments.
GPU pass‑through allows a physical GPU on a cloud host to be assigned directly to a virtual machine, delivering near‑bare‑metal performance for AI, deep learning, scientific computing and graphics workloads, with minimal latency, full driver support, and broad compatibility across DirectX and OpenGL applications.
This article reviews Jia Yangqing’s insights on why deep learning finally succeeded—highlighting the roles of big data and high‑performance computing—while examining its current limitations, emerging challenges, and future opportunities across AI engineering, AutoML, and hardware‑software co‑design.
InfiniBand is a high‑performance network protocol that uses credit‑based flow control and switched fabric architecture to provide low latency, high bandwidth, and reliable data transfer, offering advantages over TCP/IP such as reduced packet loss, efficient RDMA, and support for various upper‑layer protocols.
This article explains how high‑performance computing (HPC) supports oil‑field exploration by detailing the stages of seismic data acquisition, processing, and interpretation, the demanding computational and storage requirements, parallel communication patterns, checkpointing, and data lifecycle management, illustrating the role of HPC in modern geophysical workflows.
Julia, a free open‑source high‑performance dynamic language, combines the ease of scripting with compiled speed, offering JIT compilation, multiple dispatch, and rich scientific libraries, and with its 1.0 release it now boasts strong benchmarks, robust tooling, and growing industry adoption.
The article recaps a Cloud+ Tech Salon session where Tencent Cloud’s one‑click Kubernetes service, the serverless Container Instance Service, and the Tencent Hub DevOps platform are detailed, illustrating how their integrated networking, storage, monitoring, and workflow features simplify large‑scale AI/ML and high‑performance scientific computing deployments in the cloud.
This article provides a comprehensive overview of Remote Direct Memory Access (RDMA), detailing its underlying principles, performance advantages over traditional TCP/IP, various protocol families such as InfiniBand, RoCE, and iWARP, and their respective hardware and software requirements.
The article provides a comprehensive overview of high‑performance computing applications, classifying cluster types, describing computing‑intensive, data‑intensive and network‑intensive workloads, and detailing specific domains such as CAE, CFD, life‑science, animation rendering and meteorology along with resource‑allocation guidance.
This article provides a comprehensive overview of high‑performance computing, covering its rapid market growth, definition, classification into high‑throughput and distributed computing, key hardware components such as CPUs, GPUs, memory types, networking technologies like InfiniBand, performance metrics, benchmarking tools, and parallel file systems.
The article provides a detailed market analysis of high‑performance computing from 2016 to 2021, covering market size, budget allocation, regional shares, key applications, the rise of AI and cloud integration, and emerging hardware and networking technologies driving future growth.
This article examines the evolution of high‑performance computing from exclusive national supercomputers to accessible cloud‑based services, outlines the three adoption stages for enterprises, and details Tencent Cloud's Batch platform features that simplify large‑scale HPC workloads.
HPC as a serviceHigh-Performance Computingbatch processing
The article explains how RDMA (Remote Direct Memory Access) reduces CPU involvement, lowers latency, and increases bandwidth in data‑center networks, describes JD.com’s practical deployments across AI, big‑data, storage, and HPC workloads, and highlights industry trends toward broader RDMA adoption.
This article explains the growing need for more efficient data‑center networking, introduces Remote Direct Memory Access (RDMA) technology, describes its working principles, operation types, and how it can be layered over TCP/Ethernet to reduce latency and CPU overhead in high‑performance environments.
This article provides a comprehensive overview of BeeGFS, covering its architecture, BeeOND on‑demand instances, quota and directory‑quota mechanisms, Buddy mirroring, supported APIs, hardware requirements, network options, and export methods via SMB/CIFS and NFS for high‑performance computing environments.
The article analyzes how expanding demand and cross‑industry convergence are driving High‑Performance Computing (HPC) to become the next technology hotspot, covering its market segmentation, cloud integration, storage challenges, key vendors, and future trends such as HPDA, Burst Buffer, and open‑source file systems.
In an interview at the 2015 HPC User Forum, experts discuss how cloud computing, big data analytics (HPDA), deep learning, and software‑defined architectures are reshaping high‑performance computing and outline emerging trends, challenges, and strategic advice for Chinese HPC vendors.
Intel announced it will cease providing its proprietary Lustre file‑system version, contribute all features to the open‑source community, designate the community build as the long‑term‑stable release, and release related Hadoop and HPC adapters, signaling a strategic shift in its high‑performance‑computing operations.
This article explains the core distinctions between distributed systems and clusters, covering their architectures, efficiency goals, typical use cases, and examples such as Hadoop MapReduce and load‑balancing clusters, while also detailing cluster types, high‑availability, load balancing, and high‑performance computing.
Former professor and hedge‑fund founder D.E. Shaw leveraged his expertise in massive parallel computing to create the Anton supercomputer, a purpose‑built machine that accelerates molecular dynamics simulations thousands of times faster than traditional supercomputers, reshaping computational chemistry and high‑frequency trading.