HadaFS: A New Burst Buffer File System for Scalable High‑Performance Computing

The article presents HadaFS, a novel burst‑buffer‑based distributed file system that combines the scalability of local burst buffers with the data‑sharing advantages of shared buffers, details its LTA architecture, metadata handling, the Hadash management tool, and extensive performance evaluations on the SNS supercomputer.

Burst BufferHPC StoragePerformance Evaluation

0 likes · 18 min read

HadaFS: A New Burst Buffer File System for Scalable High‑Performance Computing

Architects' Tech Alliance

Jun 13, 2023 · Fundamentals

HadaFS: A Scalable Burst Buffer File System for Exascale Supercomputers

The article introduces HadaFS, a novel burst‑buffer file system that combines the scalability and performance of local burst buffers with the data‑sharing and cost advantages of shared buffers, details its LTA architecture, metadata handling, and evaluates its superior performance on the SNS supercomputer against BeeGFS and traditional GFS solutions.

Burst BufferHPCPerformance Evaluation

0 likes · 16 min read

HadaFS: A Scalable Burst Buffer File System for Exascale Supercomputers

Architects' Tech Alliance

Aug 27, 2020 · Fundamentals

Understanding Burst Buffer Technology and Its Role in High‑Performance Computing (HPC)

Burst Buffer is a storage acceleration technology that enhances I/O bandwidth and OPS for high‑performance computing by providing fast checkpoint/restart, temporary storage, and balancing SSD and parallel file system resources, with implementations from DDN, Cray, EMC, and IBM detailed for HPC designers.

Burst BufferCheckpointHPC

0 likes · 5 min read

Understanding Burst Buffer Technology and Its Role in High‑Performance Computing (HPC)

Architects' Tech Alliance

Jun 14, 2019 · Fundamentals

Understanding Burst Buffer Technology and Its Role in High‑Performance Computing (HPC)

The article explains what Burst Buffer technology is, how it leverages flash/SSD storage to boost I/O bandwidth and operations per second in HPC environments, details NERSC's Cray DataWarp implementation, outlines the hardware and software architecture, and surveys similar solutions from other vendors.

Burst BufferDataWarpHPC

0 likes · 15 min read

Architects' Tech Alliance

May 26, 2017 · Industry Insights

Is High‑Performance Computing the Next Tech Hotspot? A Deep Dive

The article analyzes how expanding demand and cross‑industry convergence are driving High‑Performance Computing (HPC) to become the next technology hotspot, covering its market segmentation, cloud integration, storage challenges, key vendors, and future trends such as HPDA, Burst Buffer, and open‑source file systems.

Burst BufferHPCHigh‑performance computing

0 likes · 12 min read

Is High‑Performance Computing the Next Tech Hotspot? A Deep Dive

Architects' Tech Alliance

Mar 14, 2017 · Fundamentals

Understanding Burst Buffer Technology and Its Role in HPC at NERSC

The article explains what Burst Buffer technology is, how NERSC integrates Cray DataWarp‑based flash/SSD buffers into its Cori supercomputer to boost I/O bandwidth and IOPS for scientific workloads, and describes the architecture, software stack, performance benefits, roadmap, and competing solutions from other vendors.

Burst BufferCray DataWarpHPC

0 likes · 11 min read

Understanding Burst Buffer Technology and Its Role in HPC at NERSC