← All projects
Running AI at scale

Daft

A fast data engine for processing images, audio, video and tables for AI, from a laptop up to big clusters.

New this week

What it does

Daft is a data processing engine for AI work. It handles images, audio, video and AI embeddings (numbers that capture meaning) alongside ordinary table data.

It can run AI steps on data at large scale, such as AI prompts, embeddings and classification, using OpenAI, Transformers or your own models. You write Python, and it uses Rust underneath for speed.

You can start on one computer and scale up to clusters. The README says it collects anonymous usage data, which you can switch off.

Who it's for

Data and AI engineers preparing large amounts of mixed data.

Can I use it without coding?

Developers only. It is a Python library used from code. New to this? Start here.

Can I run it?

Cost
FreeNothing to pay or sign up for.
Computer
An ordinary computer is fine
Privacy
Your choice: run it on your device or use an online service
API key
Not needed

Try it

Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?

Before you install

  • Only download from the official GitHub page. Copies with similar names exist for many popular projects.
  • License (Apache-2.0): Permissive: free to use, change and share, including for business.
  • More on staying safe

Where people are talking about it