What it does
Data-Juicer is a toolkit for turning raw, messy data into clean data ready for AI. It provides many building blocks to clean, create and analyse text, image, audio and video data.
Its makers say you can write reusable recipes and scale the work from a single laptop up to large clusters of computers.
It is used for tasks such as cleaning data for training models, preparing data for agents, and building search indexes.
Who it's for
Machine learning engineers and researchers preparing data to train or improve AI models.
Can I use it without coding?
Developers only. It is used by writing recipes and running commands, aimed at technical users. New to this? Start here.
Can I run it?
- Cost
- FreeNothing to pay or sign up for.
- Runs on
- Mac, Linux, Server
- Computer
- An ordinary computer is fine
- Privacy
- Your choice: run it on your device or use an online service
- API key
- Not needed
Try it
Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?
Before you install
- Only download from the official GitHub page. Copies with similar names exist for many popular projects.
- License (Apache-2.0): Permissive: free to use, change and share, including for business.
- More on staying safe
Where people are talking about it
- Data-JuicerResearch paper · Jan 2025