Apache Spark is a multi-language engine for executing data engineering, data science, and machine learning on single-node machines or clusters.
Apache Airflow
Apache Airflow lets users author, schedule, and monitor workflows programmatically.
About Apache Airflow
Apache Airflow is an open-source platform for programmatically authoring, scheduling, and monitoring workflows. Workflows are defined as code (called DAGs), which makes them more maintainable, versionable, testable, and collaborative. The Airflow scheduler executes tasks on workers according to specified dependencies, and the platform includes command line utilities for DAG management and a web interface for visualizing pipelines, monitoring progress, and troubleshooting. It is commonly used for data pipelines, machine learning orchestration, and coordinating AI/agentic workloads, and performs best with mostly static, slowly changing workflows.
Key features
- Programmatic authoring of versionable, testable workflow DAGs
- Task scheduling with dependency management across workers
- Web UI for pipeline visualization and progress monitoring
- Command line utilities for DAG management and operations
- Orchestration of traditional data pipelines
- Support for ML and LLM/agentic AI workload orchestration
Best for: Teams that need to orchestrate static or slowly changing data pipelines, machine learning workflows, and AI/agentic workloads benefit most.
Good for
- Workflows defined as code are maintainable, versionable, testable, and collaborative
- Rich command line utilities simplify complex DAG management
- Web UI enables straightforward pipeline visualization, monitoring, and troubleshooting
Watch out for
- Optimized for mostly static, slowly changing workflows, not highly dynamic DAGs
Apache Airflow at a glance
- Website
- github.com/apache/airflow
- Category
- Development › DevOps & Containers
- Type
- Open-source project
- Pricing
- Not confirmed. Check the site
- Open source
- Yes · Source code
- Language
- English
- Last checked
- Oct 5, 2026 · Online when checked
- Listed
- Oct 5, 2026
Apache Airflow alternatives
Tools and sites you could use instead, ranked by how closely they match.
Use Argo Workflows to programmatically define, schedule, and execute workflows on Kubernetes.
Open source
24 alternatives
Luigi provides Python tools for building batch job pipelines with dependency and workflow management.
Open source
24 alternatives
Argo provides a workflow engine for running and coordinating jobs on Kubernetes clusters.
Open source
24 alternatives
The Volcano project provides cloud native batch scheduling software within the CNCF ecosystem.
Open source
24 alternatives
Docker Hub is a container image registry for developers to find, use, and share container images.
Pick
24 alternativesPopular in DevOps & Containers
Well-known listings from the same topic.
Dockerdocker.comDesktop Appdocker.com/products/docker-desktopPodman Desktoppodman-desktop.ioSetupthanos.ioTrigger.devtrigger.devDozzledozzle.dev
Apache Airflow FAQ
What is Apache Airflow?
Apache Airflow is a platform to programmatically author, schedule, and monitor workflows.
How are workflows structured in Apache Airflow?
Workflows are defined as code (called DAGs), making them more maintainable, versionable, testable, and collaborative.
What types of workloads can Apache Airflow orchestrate?
It supports orchestration of data pipelines, machine learning workflows, and agentic or LLM-based AI workloads.
Is something wrong or out of date?
Tell us and an editor will check it.
Own this website?
Claim this listing
Claim the listing and suggest updates yourself. An editor checks every claim first.