Tagged articles

MetaDB

4 articles · Page 1 of 1
Baidu Intelligent Cloud Tech Hub
Baidu Intelligent Cloud Tech Hub
Aug 27, 2026 · Big Data

PFS L3 Architecture Deep Dive: Redesigning Parallel File Storage for AI Production Workloads

Baidu's PFS L3 rearchitects parallel file storage for AI production loads with a hybrid data engine (Aries + BlockServer), scalable metadata foundation (MetaDB), high-performance client (RapidFC), RDMA network tuning, transparent tiering to object storage, and AgenticFS for multi-tenant Agent workloads, proven in RL training saving 30k GPU-hours weekly.

AI storageAgenticFSAries
0 likes · 29 min read
PFS L3 Architecture Deep Dive: Redesigning Parallel File Storage for AI Production Workloads
Baidu Intelligent Cloud Tech Hub
Baidu Intelligent Cloud Tech Hub
Jul 31, 2026 · Databases

MetaDB Enables Databases to Truly Understand File Systems – Accepted to NSDI’27

MetaDB, the unified metadata layer for Baidu Cloud Storage, was accepted to NSDI'27 after more than five years of production use, delivering up to 10.7× higher same‑directory throughput, halving the required metadata machines, and addressing three fundamental shortcomings of generic distributed databases in handling file‑system metadata.

MetaDBNSDI 2027cloud storage
0 likes · 10 min read
MetaDB Enables Databases to Truly Understand File Systems – Accepted to NSDI’27