Bilibili Tech
Mar 30, 2022 · Big Data
HDFS Architecture, Optimizations, and Future Plans at Bilibili
Bilibili’s HDFS now runs a three‑tier architecture—access, metadata, and data layers—enhanced with a custom MergeFS router, observer NameNode, dynamic load balancing, fast‑failover pipelines, and storage‑aware policies, while future work targets transparent erasure coding, tiered data routing, lock refinements, and a Hadoop 3.x migration.
Big DataHDFSMetadata Scaling
0 likes · 22 min read