Run AI on your computer
Run AI models privately on your own laptop or desktop, often without an internet connection.
25 projects, highest rated first.
llama.cpp
The fast engine that makes it possible to run AI models on ordinary computers and phones.
Run AI on your computerOllama
Download and run AI chat models on your own computer, without sending your data to the cloud.
Run AI on your computerLocalAI
Runs many kinds of AI models on your own hardware, for text, images, voice and video, with no graphics card required.
Run AI on your computerJan
A desktop app for chatting with AI models that run privately on your own computer.
Run AI on your computerllmfit
Checks your computer and tells you which AI models it can run well.
Run AI on your computeroMLX
Runs AI chat models on Apple Silicon Macs, managed from a menu bar app.
Run AI on your computerMLC LLM
Prepares AI chat models to run directly on phones, laptops and in web browsers.
Run AI on your computerMNN
A lightweight engine from Alibaba for running AI models, including chat models, directly on phones and other devices.
Run AI on your computerWebLLM
Runs AI chat models directly inside your web browser, with no server needed.
Run AI on your computermistral.rs
A fast engine for running open AI models on your own machine, with a chat page and built-in tools.
Run AI on your computerLemonade
Runs AI models for chat, coding, speech and images on your own PC's graphics chip, for free and privately.
Run AI on your computerODS (Osmantic Deployment System)
Sets up a full private AI system on your own computer, with chat, voice, workflows and image tools.
Run AI on your computerPowerInfer
Runs large AI language models faster on a home computer with a single ordinary graphics card.
Run AI on your computerllama-swap
Switches between several local AI models automatically, loading whichever one an app asks for.
Run AI on your computerMLX-VLM
Run and fine-tune AI models that understand images, audio and video on your Mac.
Run AI on your computerCactus
An engine for running AI models directly on phones, wearables and other small devices.
Run AI on your computerkimi-k3-in-c
Runs the giant Kimi K3 AI model on one ordinary computer, slowly, using about 8 GB of memory.
Run AI on your computerAirLLM
Lets very large AI language models run on a computer with a modest graphics card.
Run AI on your computerOlares
Turns a computer you own into a personal cloud for running AI assistants, models and apps privately.
Run AI on your computerTurboFieldfare
Runs Google's large Gemma 4 AI model on Apple Silicon Macs using only about 2 GB of memory.
Run AI on your computerapfel
Lets you use the AI model built into newer Macs from the command line or other apps, fully offline.
Run AI on your computerShimmy
A tiny single-file program that runs AI chat models on your computer and works with existing AI apps.
Run AI on your computerlms (LM Studio CLI)
A command-line tool for LM Studio that loads local AI models and starts its local server.
Run AI on your computerGenieX
Runs AI chat and vision models directly on devices with Qualcomm Snapdragon chips.
Run AI on your computerRWKV Runner
A small desktop app that downloads and runs RWKV AI models on your own computer with one click.