Sep 2, 2025 · Cloud Native

Unlock Microsecond I/O: Inside PoleFS’s NVMe‑Accelerated, S3‑Backed Cloud‑Native File System

PoleFS is a self‑developed, cloud‑native distributed file system that combines POSIX‑compatible interfaces, a high‑performance NVMe cache layer, and low‑cost S3 object storage to achieve microsecond latency, millions of IOPS, massive directory scalability, multi‑protocol access, and flexible client‑side caching for AI, big data, and container workloads.

Cloud Native StorageDistributed File SystemNVMe cache

0 likes · 9 min read

Unlock Microsecond I/O: Inside PoleFS’s NVMe‑Accelerated, S3‑Backed Cloud‑Native File System

Bilibili Tech

Mar 30, 2022 · Big Data

HDFS Architecture, Optimizations, and Future Plans at Bilibili

Bilibili’s HDFS now runs a three‑tier architecture—access, metadata, and data layers—enhanced with a custom MergeFS router, observer NameNode, dynamic load balancing, fast‑failover pipelines, and storage‑aware policies, while future work targets transparent erasure coding, tiered data routing, lock refinements, and a Hadoop 3.x migration.

Big DataDistributed File SystemHDFS

0 likes · 22 min read

HDFS Architecture, Optimizations, and Future Plans at Bilibili