Plain-AyI
← All projects
Running AI at scale

Apache Airflow

Schedules and monitors chains of automated tasks, such as data processing and AI model training jobs.

What it does

Airflow is a platform for building workflows: sets of tasks that must run in a certain order, on a schedule. People write these workflows as code, and Airflow runs each step, waits for the ones it depends on, and shows progress in a web dashboard.

It is often used to move and process data. Its makers say it is also widely used to run machine learning jobs, such as training, retraining and testing models, and increasingly to coordinate the steps of AI pipelines.

Who it's for

Data engineers and teams who run regular data or AI jobs.

Can I use it without coding?

Developers only. Workflows are written in Python, and running it requires server setup. New to this? Start here.

Can I run it?

Cost
FreeNothing to pay or sign up for.
Runs on
Linux, Mac, Server
Computer
Made for servers or data centres
API key
Not needed

Try it

Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?

Before you install

  • Only download from the official GitHub page. Copies with similar names exist for many popular projects.
  • License (Apache-2.0): Permissive: free to use, change and share, including for business.
  • More on staying safe

Where people are talking about it