Plain-AyI
← All projects
Running AI at scale

LiteLLM

Lets programs talk to over 100 AI model providers in one common way, with cost tracking built in.

What it does

Different AI providers, like OpenAI, Anthropic, Google and Amazon, each have their own way for programs to connect. LiteLLM gives developers one shared way to call all of them, using the same format as OpenAI's API (an API is a doorway that lets programs talk to each other).

It can be used as a code library or run as a "gateway", a central service that a whole team or company sends its AI requests through. The gateway adds spending tracking, access keys, safety checks, load balancing across providers, logging and an admin dashboard.

This makes it easier to switch providers without rewriting code, and to see and control how much AI use costs across an organisation.

Who it's for

Developers and IT teams that use several AI providers and want one place to manage access and spending.

Can I use it without coding?

Developers only. It's a code library or a server you deploy and configure. New to this? Start here.

Can I run it?

Cost
Free, with optional paid extrasThe open-source version is free; the makers also sell a hosted or pro version.
Runs on
Server
Privacy
Sends what you give it to an online service
API key
Needed. An API key is a password-like code from an online AI service. What's that?

Try it

Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?

Before you install

  • Only download from the official GitHub page. Copies with similar names exist for many popular projects.
  • No standard license listed. Check the GitHub page before using it for business.
  • Keep your API key private. Never paste it into websites or share it, and set a spending limit with the AI service.
  • What you type or upload is sent to an online service. Avoid sharing private or sensitive information.
  • More on staying safe

Where people are talking about it