Workflow Scheduling

DataFunSummit

Jul 15, 2022 · Big Data

Apache DolphinScheduler Practice at Xinwang Bank

Xinwang Bank leverages Apache DolphinScheduler to handle over 9,000 daily task instances across real‑time, near‑real‑time, and offline batch scenarios, detailing background, application scenarios, optimizations, workflow improvements, import/export enhancements, alert system upgrades, and future plans to expand data‑ops capabilities.

Apache DolphinSchedulerDataOpsReal-time Processing

0 likes · 13 min read

Apache DolphinScheduler Practice at Xinwang Bank

iQIYI Technical Product Team

Jul 26, 2018 · Big Data

Gear: An Internal Workflow Scheduling System for Hadoop at iQIYI

Gear is iQIYI’s internal, high‑availability workflow scheduler built on Apache Oozie and extended with a YAML‑based definition language, GitLab‑driven submission, and a web UI, enabling thousands of daily Hadoop/Spark jobs, complex dependencies, retries, and monitoring, and evolving from SSH‑centric 1.x to feature‑rich 2.x.

Big DataHadoopOozie

0 likes · 14 min read

Gear: An Internal Workflow Scheduling System for Hadoop at iQIYI