What it does
mistral.rs runs open AI models, including text, image, video and audio models, on your own computer or server. It comes as a single program that can chat, serve models to other apps and run speed tests.
It offers a built-in web chat page and works like the OpenAI and Anthropic services, so existing apps can connect to it. It also has agent features such as web search and running code.
It supports Apple Silicon Macs, NVIDIA graphics cards and ordinary processors. Its makers publish benchmarks comparing its speed with other engines.
Who it's for
Developers and enthusiasts who want to run AI models locally or on their own servers.
Can I use it without coding?
With some setup. An install script sets it up, but you use it from the command line. New to this? Start here.
Can I run it?
- Cost
- FreeNothing to pay or sign up for.
- Runs on
- Mac, Windows, Linux, Server
- Computer
- Works best on a powerful computer or one with a graphics card (GPU)
- Privacy
- Runs on your own device: your data stays with you
- API key
- Not needed
Try it
- Install it on Mac, Linux or Windows using the install script described in the README.
- Start it with a model and open the built-in web chat page.
Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?
Before you install
- Only download from the official GitHub page. Copies with similar names exist for many popular projects.
- License (MIT): Very permissive: free to use, change and share, including for business.
- More on staying safe