What it does
LocalAI is an engine for running AI models on your own computer or server instead of in the cloud. It handles chat models, image generation, speech, vision and video, all behind one interface.
It speaks the same language as popular services like OpenAI, Anthropic and ElevenLabs, so apps built for those services can use it instead. It only downloads the parts each model needs, and works on many kinds of hardware, including ordinary processors without a graphics card.
It also includes user accounts and quotas, built-in AI agents and tools for adjusting models. Its makers say your data never leaves your own setup.
Who it's for
People and organisations who want private, self-hosted AI, and developers who want a local stand-in for cloud AI services.
Can I use it without coding?
With some setup. There's a Mac app and Docker containers. Some setup is needed to choose and download models. New to this? Start here.
Can I run it?
- Cost
- FreeNothing to pay or sign up for.
- Runs on
- Mac, Linux, Server
- Computer
- An ordinary computer is fine
- Privacy
- Runs on your own device: your data stays with you
- API key
- Not needed
Try it
- Or run it with Docker, picking the version for your graphics card or CPU.
- Load a model from its gallery and start using it.
Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?
Before you install
- Only download from the official GitHub page or the official download page above. Copies with similar names exist for many popular projects.
- License (MIT): Very permissive: free to use, change and share, including for business.
- More on staying safe
Where people are talking about it
- Why we write our own C and C++ inference enginesHacker News · Jul 2026