What it does
Soup is a tool for fine-tuning, which means teaching an existing AI language model new skills using your own examples. You write one simple settings file and run one command.
It tries to handle the fiddly parts automatically, such as batch size, graphics card detection and compression. Its makers say an optional, still-experimental feature can fine-tune fairly large models on a laptop graphics card with only 4 GB of memory.
It works locally on your own graphics card, with no cloud required, and also has a web interface.
Who it's for
Developers and hobbyists who want to customise open AI models on their own hardware.
Can I use it without coding?
Developers only. It's installed with Python and run from the command line. New to this? Start here.
Can I run it?
- Cost
- FreeNothing to pay or sign up for.
- Runs on
- Mac, Windows, Linux
- Computer
- Works best on a powerful computer or one with a graphics card (GPU)
- Privacy
- Runs on your own device: your data stays with you
- API key
- Not needed
Try it
Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?
Before you install
- Only download from the official GitHub page. Copies with similar names exist for many popular projects.
- License (Apache-2.0): Permissive: free to use, change and share, including for business.
- More on staying safe
Where people are talking about it
- Show HN: Fine-tune an 8B model on a 4 GB laptop GPUHacker News · Aug 2026