Art of Distributed System Architecture Design

Jul 10, 2015 · Big Data

Improving Hive Storage Efficiency: From RCFile to ORCFile at Facebook

Facebook’s data warehouse, storing over 300 PB and growing by 600 TB daily, transitioned from the RCFile format to an optimized ORCFile implementation, achieving 5‑8× better compression and up to three‑fold faster write performance while maintaining high read efficiency.