21CTO

Aug 4, 2024 · Operations

How Netflix’s Open‑Source Maestro Powers Scalable Data & ML Workflows

Netflix has open‑sourced its Maestro workflow orchestrator, a highly scalable, DAG‑based system built on Git, Java, Gradle and Docker that handles millions of daily jobs for data scientists, enabling ETL, ML pipelines, A/B testing and more, while meeting strict SLOs.