Speculative Partial Writes in Erasure-Coded Storage Systems (PBS Design and Evaluation)
The paper translates a USENIX'17 study on speculative partial writes for erasure‑coded storage, introducing PBS (Parity‑Based Speculation) which logs parity changes to turn costly random writes into sequential appends, achieving write IOPS and latency comparable to triple‑replication while maintaining fast recovery and high EC encoding throughput.
This article presents a Chinese translation of the USENIX'17 paper "Speculative Partial Writes in Erasure-Coded Systems". It explains that erasure coding (EC) improves storage efficiency but incurs significant write overhead, especially when write offsets are not aligned with EC groups, leading to costly partial writes.
Traditional solutions read the untouched data, recombine, and rewrite the whole EC group, or use incremental encoding based on data differences, both of which still require costly read‑modify‑write cycles on HDDs.
The authors propose a speculative partial‑write mechanism called PBS (Parity‑Based Speculation). PBS logs changes on parity blocks, allowing speculative writes that can later be confirmed or rolled back, reducing unnecessary reads and converting random writes into sequential appends.
Implementation details are built on Meituan’s distributed block storage system Ursa, providing strong consistency. The paper includes experimental results showing EC encoding/decoding throughput of 5–13 GB/s per CPU core, and PBS achieving write IOPS and latency comparable to three‑replica systems, outperforming prior EC‑PLog methods.
Failure‑recovery tests demonstrate that log size has limited impact on recovery speed thanks to in‑memory indexing.
Signed-in readers can open the original source through BestHub's protected redirect.
This article has been distilled and summarized from source material, then republished for learning and reference. If you believe it infringes your rights, please contactand we will review it promptly.
Meituan Technology Team
Over 10,000 engineers powering China’s leading lifestyle services e‑commerce platform. Supporting hundreds of millions of consumers, millions of merchants across 2,000+ industries. This is the public channel for the tech teams behind Meituan, Dianping, Meituan Waimai, Meituan Select, and related services.
How this landed with the community
Was this worth your time?
0 Comments
Thoughtful readers leave field notes, pushback, and hard-won operational detail here.
