Didi Tech
Jan 22, 2021 · Big Data
Erasure Coding Practice in HDFS at Didi: Principles, Implementation, and Lessons Learned
Didi migrated HDFS to Hadoop 3.2 and implemented erasure coding—using XOR and Reed‑Solomon RS(6,3) striping—to replace three‑replica storage for cold data, building back‑ported clients, automated conversion tools, and cross‑datacenter backup pipelines, while addressing operational bugs and noting performance trade‑offs.
Big DataDidiErasure Coding
0 likes · 11 min read