Efficient Ops

Mar 8, 2017 · Big Data

Inside iQIYI’s Massive Hadoop Platform: Architecture, Ops, and the Gear Workflow Engine

iQIYI’s Hadoop platform, built since 2010, now spans over a thousand nodes and 60 PB storage, detailing its architectural evolution, operational management practices, encountered challenges, and the custom Gear workflow system that streamlines job scheduling, dependencies, and alerts for large‑scale data processing.