← All projects
Learning resources

LLM Engineer Toolkit

A sorted list of over a hundred software libraries for building with large language models.

New this week

What it does

This is a curated list of code libraries for working with large language models (LLMs), the technology behind chatbots like ChatGPT.

The libraries are grouped by task, such as training, building apps, document search (RAG), running models, agents, evaluation, monitoring, prompts and safety. Each entry has a one-line description and a link.

The README also promotes the author's related lists, a newsletter and a paid book.

Who it's for

Developers and AI engineers looking for tools to build LLM applications.

Can I use it without coding?

Yes. It's a list you read on GitHub; nothing to install. New to this? Start here.

Can I run it?

Cost
FreeNothing to pay or sign up for.
Runs on
Web browser
Computer
An ordinary computer is fine
API key
Not needed

Try it

  1. Open the project page and browse the categories to find tools for what you want to build.

Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?

Before you install

  • Only download from the official GitHub page. Copies with similar names exist for many popular projects.
  • License (Apache-2.0): Permissive: free to use, change and share, including for business.
  • More on staying safe

Where people are talking about it