Apache DolphinScheduler Practice at Xinwang Bank

Xinwang Bank leverages Apache DolphinScheduler to handle over 9,000 daily task instances across real‑time, near‑real‑time, and offline batch scenarios, detailing background, application scenarios, optimizations, workflow improvements, import/export enhancements, alert system upgrades, and future plans to expand data‑ops capabilities.

Apache DolphinSchedulerBig DataDataOps

0 likes · 13 min read

Apache DolphinScheduler Practice at Xinwang Bank

Big Data Technology & Architecture

May 10, 2022 · Big Data

Analyzing Apache DolphinScheduler 2.x Source Code: Environment Setup, Service Startup, Task Execution, and Insights

This article presents a detailed walkthrough of Apache DolphinScheduler 2.x source code, covering environment preparation, service startup procedures for Master and Worker, task execution flow, key components like Netty and Zookeeper, and personal reflections on open‑source learning and improvement.

Apache DolphinSchedulerWorkflow Schedulingjava

0 likes · 12 min read

Analyzing Apache DolphinScheduler 2.x Source Code: Environment Setup, Service Startup, Task Execution, and Insights

iQIYI Technical Product Team

Jul 26, 2018 · Big Data

Gear: An Internal Workflow Scheduling System for Hadoop at iQIYI

Gear is iQIYI’s internal, high‑availability workflow scheduler built on Apache Oozie and extended with a YAML‑based definition language, GitLab‑driven submission, and a web UI, enabling thousands of daily Hadoop/Spark jobs, complex dependencies, retries, and monitoring, and evolving from SSH‑centric 1.x to feature‑rich 2.x.

HadoopJob ManagementOozie

0 likes · 14 min read

Gear: An Internal Workflow Scheduling System for Hadoop at iQIYI