BestHub
Sign in
Tagged articles
3 articles
Page 1 of 1
Big Data Technology & Architecture
Big Data Technology & Architecture
Mar 14, 2022 · Big Data

Comparison of Common Big Data Scheduling Systems: Oozie, Azkaban, Airflow, XXL‑Job, and DolphinScheduler

This article provides a comparative overview of several popular big‑data workflow schedulers—including Oozie, Azkaban, Airflow, XXL‑Job, and DolphinScheduler—detailing their supported task types, visual workflow definition, monitoring capabilities, pause/resume features, high‑availability options, and other notable characteristics.

AirflowDolphinSchedulerOozie
0 likes · 9 min read
Comparison of Common Big Data Scheduling Systems: Oozie, Azkaban, Airflow, XXL‑Job, and DolphinScheduler
iQIYI Technical Product Team
iQIYI Technical Product Team
Jul 26, 2018 · Big Data

Gear: An Internal Workflow Scheduling System for Hadoop at iQIYI

Gear is iQIYI’s internal, high‑availability workflow scheduler built on Apache Oozie and extended with a YAML‑based definition language, GitLab‑driven submission, and a web UI, enabling thousands of daily Hadoop/Spark jobs, complex dependencies, retries, and monitoring, and evolving from SSH‑centric 1.x to feature‑rich 2.x.

HadoopJob ManagementOozie
0 likes · 14 min read
Gear: An Internal Workflow Scheduling System for Hadoop at iQIYI