1 views collected around this technical thread.
This article provides a comprehensive comparison of Apache Airflow and Argo Workflows, covering their core features, architectures, use cases, code examples, and recommendations for selecting the appropriate distributed workflow engine in data engineering, big‑data, and AI pipelines.
StrmVol storage volumes replace the FUSE‑based OSS mount with a virtual block device and kernel‑mode file system, dramatically reducing latency for massive small‑file reads in Kubernetes workloads such as AI training datasets, and the article demonstrates setup, configuration, and performance testing using Argo Workflows.
Argo Workflows is an open‑source, container‑native engine that runs on Kubernetes via Custom Resource Definitions, letting users declaratively define complex, step‑or DAG‑based pipelines—including CI/CD, data processing, and machine‑learning jobs—through reusable templates, with a server UI, controller, and pod architecture monitored by Prometheus.
This article provides a comprehensive analysis of Argo Workflows 3.6, covering its enhanced scheduling, UI improvements, controller stability and security upgrades, OSS artifact garbage collection, dynamic template references, expanded expression library, and CLI usability, along with practical YAML examples for each feature.
This article compares a cloud‑provider’s closed‑source Batch compute service with the open‑source, serverless Argo Workflows platform, demonstrating how each can orchestrate multi‑stage containerized data‑processing pipelines, detailing configuration, job definitions, dependency handling, and operational trade‑offs.
This article explains how to use the Kubernetes-native Argo Workflows engine to automate and scale complex gene-computing pipelines, detailing its advantages, challenges, and a step-by-step BWA alignment workflow example on Alibaba Cloud’s ACK platform.
This guide explains how to create a fully automated, event‑driven CI pipeline on Kubernetes by combining Alibaba Cloud EventBridge with the ACK One Serverless Argo Workflows service to trigger builds from Git events, compile Docker images with BuildKit cache, and deploy them via GitOps.
This article introduces Argo Workflows, explains the challenges of YAML‑based definitions, and demonstrates how the Hera Python SDK can streamline workflow creation, testing, and submission on Alibaba Cloud ACK Serverless clusters with practical DAG‑diamond and Map‑Reduce examples.
Argo Workflows, a cloud‑native Kubernetes job orchestrator, offers superior autoscaling, concurrency, cost efficiency, and seamless integration with the Argo ecosystem compared to Jenkins, and the article provides a detailed tutorial on deploying a Go‑based CI pipeline on ACK One Serverless Argo with BuildKit, NAS caching, and parameterized workflow templates.
The article introduces ACK One Serverless Argo Workflows, a fully managed cloud‑native workflow service that adds chunked large‑file uploads, automatic artifact garbage collection, and OSS streaming download to overcome limitations of the open‑source Argo Workflows in high‑volume data scenarios.