Tagged articles
DolphinScheduler
12 articles · Page 1 of 1

XikeAug 3, 2026 · Big Data
This article walks through using Apache DolphinScheduler 3.2.2 in a lightweight Docker standalone setup to model, create, and run an ODS → ETL → ADS offline workflow via the Open API, demonstrating dependency handling, retries, backfill, and troubleshooting for reliable daily batch processing.
DockerDolphinSchedulerOpen API
0 likes · 12 min read

This article describes the design and implementation of a platform‑wide Data Quality Center for offline big‑data pipelines, covering research of existing solutions, design goals, system architecture based on DolphinScheduler, rule definition language, binding and execution mechanisms, and future enhancements such as lineage monitoring and real‑time checks.
Apache GriffinDolphinSchedulerQualitis
0 likes · 18 min read

Compass is an open‑source big‑data diagnostic platform developed by OPPO that provides non‑intrusive, real‑time monitoring and root‑cause analysis for offline and streaming tasks on schedulers such as DolphinScheduler and Airflow, covering workflow‑level failures, Spark engine anomalies, resource usage, and offering one‑click reports and extensible rule‑based diagnostics.
DolphinSchedulerSparkTask Diagnosis
0 likes · 13 min read

This article details Lenovo’s implementation of a unified scheduling center using Apache DolphinScheduler, covering background requirements, reasons for choosing the platform, architectural evolution, feature enhancements, and practical deployments such as HTTP task parameter passing, Java task plugins, global parameters, and future roadmap.
DolphinSchedulerLenovoWorkflow
0 likes · 19 min read

DolphinScheduler is an open‑source distributed task scheduling system that supports multiple task types, offers visual workflow orchestration and monitoring, and scales to thousands of servers, making it a robust solution for backend and big‑data processing scenarios.
Distributed SchedulingDolphinSchedulerTask Automation
0 likes · 4 min read

This article provides a comprehensive overview of DolphinScheduler’s design strategies, distributed architecture, fault‑tolerance mechanisms, configuration files, core APIs, Quartz integration, master‑worker execution flow, RPC communication, load‑balancing algorithms, and logging services, accompanied by detailed code excerpts and diagrams.
DolphinSchedulerQuartzRPC
0 likes · 46 min read

This article provides an in‑depth technical overview of Apache DolphinScheduler, covering its distributed design strategies, fault‑tolerance mechanisms, remote log access, source‑code module breakdown, API interfaces, Quartz integration, master‑worker execution flows, RPC communication, load‑balancing algorithms, logging services, and community contribution guidelines.
Distributed SchedulingDolphinSchedulerLog Service
0 likes · 47 min read

This article introduces the DolphinScheduler OpenMLDB Task, explains how it integrates OpenMLDB's feature platform into DolphinScheduler workflows to create a complete MLOps pipeline, and provides a step‑by‑step demonstration using the TalkingData ad‑fraud detection dataset from Kaggle.
DolphinSchedulerMLOpsOpenMLDB
0 likes · 7 min read

This article provides a comparative overview of several popular big‑data workflow schedulers—including Oozie, Azkaban, Airflow, XXL‑Job, and DolphinScheduler—detailing their supported task types, visual workflow definition, monitoring capabilities, pause/resume features, high‑availability options, and other notable characteristics.
AirflowDolphinSchedulerOozie
0 likes · 9 min read

This article presents an in‑depth overview of Youzan's data platform, introduces the DP data development platform with its key features and workflow, details the core module architecture—including service, scheduling, and component layers—and explains the migration from Airflow to DolphinScheduler to improve performance, stability, and scalability.
Data developmentDolphinSchedulerScheduling
0 likes · 14 min read


政采云技术Feb 24, 2022 · Backend Development
This article explains how DolphinScheduler (DS) implements workflow versioning by introducing integer‑based versions, describes the core principles of workflow and task relationships, outlines the key database tables and architecture, and provides detailed Java code for creating, updating, and managing workflow definitions, tasks, and their relations.
BackendDolphinSchedulerVersioning
0 likes · 13 min read

The article examines DP's rapid growth in daily scheduled tasks, outlines the limitations of its Airflow‑based scheduler, compares Airflow with DolphinScheduler, and details the architectural redesign, migration steps, and future plans for a more scalable, reliable big‑data workflow system.
AirflowDolphinSchedulerScheduling
0 likes · 13 min read
