Plain-AyI
← All projects
Run AI on your computer

llama.cpp

The fast engine that makes it possible to run AI models on ordinary computers and phones.

What it does

llama.cpp is the engine that made running large AI models on everyday hardware practical. It squeezes models down so they fit in normal computer memory and run quickly, even without an expensive graphics card.

Many popular local-AI apps are built on top of it. It also comes with its own simple chat page you can open in a web browser.

In early 2026 the team behind it joined Hugging Face, the largest home for open AI models, to support the project long-term.

Who it's for

Tinkerers and developers who want the most control and speed when running AI on their own hardware.

Can I use it without coding?

With some setup. Ready-made downloads exist, but you start it from the command line. New to this? Start here.

Can I run it?

Cost
FreeNothing to pay or sign up for.
Runs on
Mac, Windows, Linux
Computer
An ordinary computer is fine
Privacy
Runs on your own device: your data stays with you
API key
Not needed

Try it

  1. Install it by following the instructions on the project's website, or download a ready-made version from the releases page.
  2. Download a model from Hugging Face and chat with it in the terminal or the built-in web page.
Official download page

Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?

Before you install

  • Only download from the official GitHub page or the official download page above. Copies with similar names exist for many popular projects.
  • License (MIT): Very permissive: free to use, change and share, including for business.
  • More on staying safe

Where people are talking about it