Plain-AyI
← All projects
Developer building blocks

llmware

A toolkit for building private AI apps that answer questions from your documents using small models on your own computer.

What it does

llmware is a Python framework for building AI applications based on your own knowledge and documents. It is designed to run on an ordinary laptop or company server rather than in the cloud, and it focuses on small, specialised models instead of giant general ones.

It has two main parts. A model catalog offers hundreds of models packaged to run efficiently on local hardware, including the project's own small models tuned for business tasks. A RAG pipeline (retrieval-augmented generation, where the AI looks up relevant documents before answering) handles reading documents, splitting and indexing them, searching them and answering with sources.

Who it's for

Developers building private, local AI tools for businesses.

Can I use it without coding?

Developers only. A Python library for programmers. New to this? Start here.

Can I run it?

Cost
FreeNothing to pay or sign up for.
Runs on
Windows, Mac, Linux
Computer
An ordinary computer is fine
Privacy
Your choice: run it on your device or use an online service
API key
Not needed

Try it

Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?

Before you install

  • Only download from the official GitHub page. Copies with similar names exist for many popular projects.
  • License (Apache-2.0): Permissive: free to use, change and share, including for business.
  • More on staying safe

Where people are talking about it