BestHub
Sign in
Tagged articles
149 articles
Page 2 of 2
DataFunTalk
DataFunTalk
Aug 17, 2022 · Cloud Computing

High‑Performance Computing Storage Challenges and Baidu Canghai Storage Solutions

This article explains the storage problems faced by traditional HPC, AI‑driven HPC and high‑performance data analysis, describes Baidu's internal high‑performance storage practices, and introduces the Baidu Canghai solution—including object storage BOS, parallel file system PFS, RapidFS, data‑flow mechanisms and a customer case—demonstrating how these technologies meet the demanding throughput, latency and cost requirements of modern high‑performance workloads.

AIBaiduHigh‑performance computing
0 likes · 29 min read
High‑Performance Computing Storage Challenges and Baidu Canghai Storage Solutions
Baidu Geek Talk
Baidu Geek Talk
Jul 26, 2022 · Industry Insights

How Baidu’s Canghai Storage Powers High‑Performance Computing: Challenges and Solutions

This article analyzes the storage challenges of high‑performance computing—including traditional HPC, AI‑driven HPC, and high‑performance data analysis—examines Baidu’s internal practices, and presents the Canghai storage platform with its object storage, parallel file system (PFS) and RapidFS solutions that address throughput, latency, and scalability requirements.

AI trainingHigh‑performance computingcloud storage
0 likes · 31 min read
How Baidu’s Canghai Storage Powers High‑Performance Computing: Challenges and Solutions
Architects' Tech Alliance
Architects' Tech Alliance
Jul 5, 2022 · Fundamentals

Understanding High‑Performance Computing (HPC): Principles, Architecture, and Performance Metrics

This article explains the fundamentals of high‑performance computing, covering serial and parallel processing, heterogeneous CPU‑GPU architectures, FLOPS measurement levels, key terminology, and why HPC is essential for scientific and engineering simulations, while also noting market reports and resource links.

FLOPSHPCHigh‑performance computing
0 likes · 6 min read
Understanding High‑Performance Computing (HPC): Principles, Architecture, and Performance Metrics
Architects' Tech Alliance
Architects' Tech Alliance
May 3, 2022 · Fundamentals

High‑Performance Computing Overview and Resource Guide

This article provides a comprehensive overview of high‑performance computing (HPC), covering its definition, hardware architectures, performance metrics, cluster components, parallel file systems, management and scheduling tools, as well as common MPI implementations and links to further technical resources.

ClusterFLOPSFile Systems
0 likes · 11 min read
High‑Performance Computing Overview and Resource Guide
Open Source Linux
Open Source Linux
Apr 11, 2022 · Fundamentals

What Is a Server? Exploring Core Components and Software

This guide explains what a server is, outlines its key hardware components, and reviews the essential software and applications that run on servers, providing a comprehensive overview for anyone interested in high‑performance computing systems.

HardwareHigh‑performance computingIT fundamentals
0 likes · 2 min read
What Is a Server? Exploring Core Components and Software
Architects' Tech Alliance
Architects' Tech Alliance
Mar 14, 2022 · Fundamentals

An Introduction to RDMA: Principles, Protocols, Advantages, and Programming Basics

This article provides a comprehensive overview of Remote Direct Memory Access (RDMA), covering its definition, how it differs from traditional networking, core advantages such as zero‑copy and CPU offload, typical use cases, the three main RDMA protocols, deployment requirements, and essential programming concepts and terminology.

CPU OffloadData centerHigh‑performance computing
0 likes · 9 min read
An Introduction to RDMA: Principles, Protocols, Advantages, and Programming Basics
Architects' Tech Alliance
Architects' Tech Alliance
Mar 2, 2022 · Cloud Computing

Bus-Level Data Center Network Technology: RDMA Acceleration and Ultra-Low Latency Innovations

The article examines bus‑level data center network technologies, detailing how RDMA and ultra‑low‑latency forwarding mechanisms reduce end‑to‑end delays, enable high‑performance computing and AI workloads, and drive the evolution toward hyper‑converged, cloud‑native infrastructures.

Data Center NetworkHigh‑performance computingRDMA
0 likes · 14 min read
Bus-Level Data Center Network Technology: RDMA Acceleration and Ultra-Low Latency Innovations
Architects' Tech Alliance
Architects' Tech Alliance
Feb 19, 2022 · Fundamentals

Understanding High Performance Computing (HPC): Principles, Architecture, and Performance Metrics

This article explains the fundamentals of high‑performance computing, covering its serial and parallel processing models, heterogeneous CPU‑GPU architectures, performance measurement in FLOPS, the scale needed for exaFLOPS systems, key terminology, and why HPC is essential for scientific and engineering challenges.

FLOPSHPCHigh‑performance computing
0 likes · 7 min read
Understanding High Performance Computing (HPC): Principles, Architecture, and Performance Metrics
Architects' Tech Alliance
Architects' Tech Alliance
Feb 16, 2022 · Fundamentals

Key Technology Trends Shaping High‑Performance Computing (HPC)

The article outlines major trends influencing high‑performance computing, including AI integration, GPU/TPU advancements, flexibility in processor architectures, HPC‑as‑a‑Service, hybrid cloud solutions, democratization, the emergence of exascale systems, and micro‑architectural improvements, while providing links to related reports and resources.

ExascaleGPUHPC
0 likes · 9 min read
Key Technology Trends Shaping High‑Performance Computing (HPC)
Architects' Tech Alliance
Architects' Tech Alliance
Dec 8, 2021 · Industry Insights

Inside Fujitsu A64FX: Architecture that Drives Japan’s Fugaku Supercomputer

The article examines Fujitsu’s A64FX ARM‑compatible processor, detailing its 7 nm FinFET design, HBM2 memory, SVE vector extensions, and system‑on‑chip integration, while comparing its engineering philosophy and performance to IBM’s BlueGene/L and explaining how these choices enabled the Fugaku supercomputer to top the Top500 list.

ARM architectureBlueGene/LFugaku
0 likes · 16 min read
Inside Fujitsu A64FX: Architecture that Drives Japan’s Fugaku Supercomputer
Architects' Tech Alliance
Architects' Tech Alliance
Oct 7, 2021 · Cloud Computing

Overview of the High‑Performance Computing Cloud (HPC Cloud) Whitepaper

The HPC Cloud whitepaper released by the Supercomputing Innovation Alliance defines high‑performance computing cloud concepts, outlines three product models, presents a reference architecture with layered services, and provides market forecasts and application scenarios for the emerging HPC‑cloud ecosystem.

HPC CloudHigh‑performance computingMulti‑Cloud
0 likes · 8 min read
Overview of the High‑Performance Computing Cloud (HPC Cloud) Whitepaper
Open Source Linux
Open Source Linux
Jul 4, 2021 · Operations

Master Linux Clusters: High Availability, Load Balancing & Performance

This article introduces Linux cluster fundamentals, explains key concepts such as scalability, high availability, load balancing, and error recovery, categorizes clusters into high‑availability, load‑balancing, and high‑performance types, and outlines common architectures, technologies, and implementation methods for building robust, fault‑tolerant systems.

ClusterHigh‑performance computingLinux
0 likes · 13 min read
Master Linux Clusters: High Availability, Load Balancing & Performance
Architects' Tech Alliance
Architects' Tech Alliance
Apr 28, 2021 · Industry Insights

Why InfiniBand Is Outpacing Ethernet in High‑Performance Computing

The article provides a comprehensive technical overview of InfiniBand, covering its history, standards, architecture layers, packet format, performance advantages, and a detailed comparison with Ethernet, highlighting why it has become the preferred high‑speed interconnect for HPC workloads.

Data TransferHigh‑performance computingInfiniBand
0 likes · 15 min read
Why InfiniBand Is Outpacing Ethernet in High‑Performance Computing
Didi Tech
Didi Tech
Jan 6, 2021 · Artificial Intelligence

Key Challenges and Technologies for Autonomous Driving Vehicle Platforms and Hardware

The article examines how electrification, intelligence, connectivity and sharing drive new autonomous‑driving requirements, detailing challenges in vehicle platform architecture, sensor technologies (camera, lidar, radar), high‑performance computing, integration, and rigorous test validation needed to achieve pre‑installed mass‑production autonomous vehicles.

AIHardware integrationHigh‑performance computing
0 likes · 15 min read
Key Challenges and Technologies for Autonomous Driving Vehicle Platforms and Hardware
Architects' Tech Alliance
Architects' Tech Alliance
Dec 3, 2020 · Fundamentals

IBM GPFS (Spectrum Scale) Overview: History, Architecture, Features, and High‑Performance Computing Use Cases

This article provides a comprehensive overview of IBM's General Parallel File System (GPFS), detailing its historical development, architectural models—including SAN, NSD, and Share‑Nothing Cluster—its operational capabilities, performance advantages, scalability, high‑availability features, and its role in large‑scale high‑performance computing environments.

Distributed File SystemGPFSHigh‑performance computing
0 likes · 12 min read
IBM GPFS (Spectrum Scale) Overview: History, Architecture, Features, and High‑Performance Computing Use Cases
Open Source Linux
Open Source Linux
Dec 2, 2020 · Fundamentals

Unlocking NFS & pNFS: How Parallel File Systems Boost Performance

This article explains the fundamentals of NFS, introduces the advanced pNFS architecture with its three protocols, compares storage layouts, and discusses performance benefits and real‑world deployments in high‑performance computing environments.

High‑performance computingNFSpNFS
0 likes · 13 min read
Unlocking NFS & pNFS: How Parallel File Systems Boost Performance
Efficient Ops
Efficient Ops
Aug 23, 2020 · Cloud Computing

Why Choose Bare Metal Servers? Uncover Their Cloud Benefits

An in‑depth look at bare metal servers explains how they differ from virtualized cloud instances, why they’re needed for performance‑critical or security‑sensitive workloads, their integration with cloud services, and market trends driving their growing adoption.

Bare Metal ServerHigh‑performance computingVirtualization
0 likes · 8 min read
Why Choose Bare Metal Servers? Uncover Their Cloud Benefits
Full-Stack Internet Architecture
Full-Stack Internet Architecture
Aug 13, 2020 · Artificial Intelligence

AI and High‑Performance Computing in Weather Forecasting: From Radar Images to Neural Networks

The article explains how modern weather forecasting in China combines traditional observations with artificial‑intelligence techniques such as U‑Net image‑to‑image models, optical‑flow analysis, and massive high‑performance computing to improve precipitation nowcasting, while also highlighting the scientific challenges and interdisciplinary nature of meteorology.

High‑performance computingNeural Networksartificial intelligence
0 likes · 8 min read
AI and High‑Performance Computing in Weather Forecasting: From Radar Images to Neural Networks
Architects' Tech Alliance
Architects' Tech Alliance
Apr 3, 2020 · Industry Insights

Why InfiniBand Beats TCP/IP: Deep Dive into Architecture and Socket Direct

This article explains how InfiniBand’s RDMA‑based architecture, layered protocol stack, and Mellanox Socket Direct technology deliver far higher bandwidth, lower latency, and better CPU efficiency than traditional TCP/IP networks, and it presents performance test results that show up to an 80% latency reduction.

FabricHigh‑performance computingInfiniBand
0 likes · 11 min read
Why InfiniBand Beats TCP/IP: Deep Dive into Architecture and Socket Direct
Alibaba Cloud Developer
Alibaba Cloud Developer
Mar 10, 2020 · Cloud Computing

How Cloud‑Based HPC Accelerates COVID‑19 Drug Discovery

This article explains how Alibaba Cloud's E‑HPC supercomputing platform provides the massive compute power needed for rapid virus research and high‑throughput drug screening, detailing the workflow, required resources, and practical code examples for parallel processing in the fight against COVID‑19.

COVID-19E-HPCHigh‑performance computing
0 likes · 15 min read
How Cloud‑Based HPC Accelerates COVID‑19 Drug Discovery
Liangxu Linux
Liangxu Linux
Jan 27, 2020 · Fundamentals

How 99 Lines of Taichi Code Enable High‑Performance CG Simulations

Taichi, a Python‑embedded DSL created by an MIT PhD, dramatically speeds up material point method simulations—achieving up to 188× faster than TensorFlow—while keeping code concise, enabling differentiable physics for graphics and AI research.

Differentiable ProgrammingHigh‑performance computingMaterial Point Method
0 likes · 9 min read
How 99 Lines of Taichi Code Enable High‑Performance CG Simulations
Architects' Tech Alliance
Architects' Tech Alliance
Apr 22, 2019 · Cloud Computing

How GPU Pass‑Through Powers Near‑Bare‑Metal Performance in Cloud VMs

GPU pass‑through allows a physical GPU on a cloud host to be assigned directly to a virtual machine, delivering near‑bare‑metal performance for AI, deep learning, scientific computing and graphics workloads, with minimal latency, full driver support, and broad compatibility across DirectX and OpenGL applications.

GPU Pass-throughHigh‑performance computingVirtualization
0 likes · 5 min read
How GPU Pass‑Through Powers Near‑Bare‑Metal Performance in Cloud VMs
Alibaba Cloud Developer
Alibaba Cloud Developer
Apr 15, 2019 · Artificial Intelligence

Why Deep Learning Finally Succeeded and What Challenges Lie Ahead

This article reviews Jia Yangqing’s insights on why deep learning finally succeeded—highlighting the roles of big data and high‑performance computing—while examining its current limitations, emerging challenges, and future opportunities across AI engineering, AutoML, and hardware‑software co‑design.

AI ChallengesAI EngineeringAutoML
0 likes · 9 min read
Why Deep Learning Finally Succeeded and What Challenges Lie Ahead
Architects' Tech Alliance
Architects' Tech Alliance
Oct 31, 2018 · Fundamentals

Understanding InfiniBand: Architecture, Protocols, and Performance

InfiniBand is a high‑performance network protocol that uses credit‑based flow control and switched fabric architecture to provide low latency, high bandwidth, and reliable data transfer, offering advantages over TCP/IP such as reduced packet loss, efficient RDMA, and support for various upper‑layer protocols.

High‑performance computingInfiniBandRDMA
0 likes · 10 min read
Understanding InfiniBand: Architecture, Protocols, and Performance
Architects' Tech Alliance
Architects' Tech Alliance
Aug 26, 2018 · Fundamentals

High‑Performance Computing Applications in Oil Exploration: Data Processing, Storage, and Workflow

This article explains how high‑performance computing (HPC) supports oil‑field exploration by detailing the stages of seismic data acquisition, processing, and interpretation, the demanding computational and storage requirements, parallel communication patterns, checkpointing, and data lifecycle management, illustrating the role of HPC in modern geophysical workflows.

HPCHigh‑performance computingOil Exploration
0 likes · 12 min read
High‑Performance Computing Applications in Oil Exploration: Data Processing, Storage, and Workflow
21CTO
21CTO
Aug 10, 2018 · Fundamentals

Why Julia Is the Zero‑Compromise Language for Data Science and High‑Performance Computing

Julia, a free open‑source high‑performance dynamic language, combines the ease of scripting with compiled speed, offering JIT compilation, multiple dispatch, and rich scientific libraries, and with its 1.0 release it now boasts strong benchmarks, robust tooling, and growing industry adoption.

Dynamic LanguageHigh‑performance computingJIT
0 likes · 11 min read
Why Julia Is the Zero‑Compromise Language for Data Science and High‑Performance Computing
Tencent Cloud Developer
Tencent Cloud Developer
Jul 5, 2018 · Cloud Native

Kubernetes One‑Click Cloud Deployment, CIS Architecture, and Tencent Hub DevOps Practices

The article recaps a Cloud+ Tech Salon session where Tencent Cloud’s one‑click Kubernetes service, the serverless Container Instance Service, and the Tencent Hub DevOps platform are detailed, illustrating how their integrated networking, storage, monitoring, and workflow features simplify large‑scale AI/ML and high‑performance scientific computing deployments in the cloud.

CISCloud NativeContainer Services
0 likes · 31 min read
Kubernetes One‑Click Cloud Deployment, CIS Architecture, and Tencent Hub DevOps Practices
Architects' Tech Alliance
Architects' Tech Alliance
Apr 22, 2018 · Fundamentals

An Overview of Remote Direct Memory Access (RDMA): Principles, Comparisons, and Implementations

This article provides a comprehensive overview of Remote Direct Memory Access (RDMA), detailing its underlying principles, performance advantages over traditional TCP/IP, various protocol families such as InfiniBand, RoCE, and iWARP, and their respective hardware and software requirements.

High‑performance computingInfiniBandLow latency
0 likes · 9 min read
An Overview of Remote Direct Memory Access (RDMA): Principles, Comparisons, and Implementations
Architects' Tech Alliance
Architects' Tech Alliance
Apr 9, 2018 · Fundamentals

Overview of High‑Performance Computing (HPC) Application Types and Domains

The article provides a comprehensive overview of high‑performance computing applications, classifying cluster types, describing computing‑intensive, data‑intensive and network‑intensive workloads, and detailing specific domains such as CAE, CFD, life‑science, animation rendering and meteorology along with resource‑allocation guidance.

Animation RenderingCAECFD
0 likes · 6 min read
Overview of High‑Performance Computing (HPC) Application Types and Domains
Architects' Tech Alliance
Architects' Tech Alliance
Apr 8, 2018 · Fundamentals

Understanding High‑Performance Computing (HPC): Market Size, Technologies, Metrics, and Core Components

This article provides a comprehensive overview of high‑performance computing, covering its rapid market growth, definition, classification into high‑throughput and distributed computing, key hardware components such as CPUs, GPUs, memory types, networking technologies like InfiniBand, performance metrics, benchmarking tools, and parallel file systems.

GPUHPCHigh‑performance computing
0 likes · 11 min read
Understanding High‑Performance Computing (HPC): Market Size, Technologies, Metrics, and Core Components
Architects' Tech Alliance
Architects' Tech Alliance
Jan 22, 2018 · Fundamentals

Comprehensive Analysis of the Global High‑Performance Computing (HPC) Market, Trends, and Emerging Technologies (2016‑2021)

The article provides a detailed market analysis of high‑performance computing from 2016 to 2021, covering market size, budget allocation, regional shares, key applications, the rise of AI and cloud integration, and emerging hardware and networking technologies driving future growth.

HPCHigh‑performance computingcloud computing
0 likes · 9 min read
Comprehensive Analysis of the Global High‑Performance Computing (HPC) Market, Trends, and Emerging Technologies (2016‑2021)
Tencent Cloud Developer
Tencent Cloud Developer
Nov 17, 2017 · Industry Insights

How Cloud Computing Is Bringing High‑Performance Computing to Everyday Enterprises

This article examines the evolution of high‑performance computing from exclusive national supercomputers to accessible cloud‑based services, outlines the three adoption stages for enterprises, and details Tencent Cloud's Batch platform features that simplify large‑scale HPC workloads.

Batch ProcessingHPC as a serviceHigh‑performance computing
0 likes · 11 min read
How Cloud Computing Is Bringing High‑Performance Computing to Everyday Enterprises
JD Tech
JD Tech
Sep 26, 2017 · Cloud Computing

Impact of RDMA Technology on High‑Performance Data Centers and Its Adoption at JD.com

The article explains how RDMA (Remote Direct Memory Access) reduces CPU involvement, lowers latency, and increases bandwidth in data‑center networks, describes JD.com’s practical deployments across AI, big‑data, storage, and HPC workloads, and highlights industry trends toward broader RDMA adoption.

Data centerDistributed SystemsHigh‑performance computing
0 likes · 6 min read
Impact of RDMA Technology on High‑Performance Data Centers and Its Adoption at JD.com
Architects' Tech Alliance
Architects' Tech Alliance
Jul 9, 2017 · Fundamentals

An Introduction to RDMA: Principles, Operation, and Integration with TCP/Ethernet

This article explains the growing need for more efficient data‑center networking, introduces Remote Direct Memory Access (RDMA) technology, describes its working principles, operation types, and how it can be layered over TCP/Ethernet to reduce latency and CPU overhead in high‑performance environments.

Data centerHigh‑performance computingRDMA
0 likes · 14 min read
An Introduction to RDMA: Principles, Operation, and Integration with TCP/Ethernet
Architects' Tech Alliance
Architects' Tech Alliance
Jul 3, 2017 · Operations

BeeGFS Features, Quotas, Mirroring, APIs, and Deployment Guidelines

This article provides a comprehensive overview of BeeGFS, covering its architecture, BeeOND on‑demand instances, quota and directory‑quota mechanisms, Buddy mirroring, supported APIs, hardware requirements, network options, and export methods via SMB/CIFS and NFS for high‑performance computing environments.

BeeGFSHigh‑performance computingmirroring
0 likes · 11 min read
BeeGFS Features, Quotas, Mirroring, APIs, and Deployment Guidelines
Architects' Tech Alliance
Architects' Tech Alliance
May 26, 2017 · Industry Insights

Is High‑Performance Computing the Next Tech Hotspot? A Deep Dive

The article analyzes how expanding demand and cross‑industry convergence are driving High‑Performance Computing (HPC) to become the next technology hotspot, covering its market segmentation, cloud integration, storage challenges, key vendors, and future trends such as HPDA, Burst Buffer, and open‑source file systems.

Burst BufferHPCHigh‑performance computing
0 likes · 12 min read
Is High‑Performance Computing the Next Tech Hotspot? A Deep Dive
Architects' Tech Alliance
Architects' Tech Alliance
Apr 24, 2017 · Fundamentals

Intel Discontinues Its Own Lustre Distribution and Shifts Development to the Open‑Source Community

Intel announced it will cease providing its proprietary Lustre file‑system version, contribute all features to the open‑source community, designate the community build as the long‑term‑stable release, and release related Hadoop and HPC adapters, signaling a strategic shift in its high‑performance‑computing operations.

HPCHigh‑performance computingIntel
0 likes · 6 min read
Intel Discontinues Its Own Lustre Distribution and Shifts Development to the Open‑Source Community
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Jun 9, 2016 · Fundamentals

Distributed vs Cluster: Key Differences and When to Use Each

This article explains the core distinctions between distributed systems and clusters, covering their architectures, efficiency goals, typical use cases, and examples such as Hadoop MapReduce and load‑balancing clusters, while also detailing cluster types, high‑availability, load balancing, and high‑performance computing.

Cluster ComputingDistributed SystemsHigh‑performance computing
0 likes · 10 min read
Distributed vs Cluster: Key Differences and When to Use Each
21CTO
21CTO
Dec 7, 2015 · Fundamentals

How D.E. Shaw’s Anton Supercomputer Revolutionized Computational Chemistry

Former professor and hedge‑fund founder D.E. Shaw leveraged his expertise in massive parallel computing to create the Anton supercomputer, a purpose‑built machine that accelerates molecular dynamics simulations thousands of times faster than traditional supercomputers, reshaping computational chemistry and high‑frequency trading.

AntonD.E. ShawHigh‑performance computing
0 likes · 9 min read
How D.E. Shaw’s Anton Supercomputer Revolutionized Computational Chemistry