Plain-AyI
← All projects
Running AI at scale

BentoML

A Python library for turning AI models into online services that apps can call.

New this week

What it does

BentoML helps developers take an AI model and turn it into an API (a doorway that lets other programs send requests and get answers). A few lines of Python can turn a model script into a working web service.

It packages your code, model and settings into Docker containers so the service runs the same way everywhere. It also includes features to make better use of processors and graphics cards, such as grouping requests together.

You can run it on your own machines or deploy to BentoCloud, the makers' paid hosting service.

Who it's for

Machine-learning engineers and developers who need to serve AI models to users or apps.

Can I use it without coding?

Developers only. It is a Python library for building and deploying services. New to this? Start here.

Can I run it?

Cost
Free, with optional paid extrasThe open-source version is free; the makers also sell a hosted or pro version.
Runs on
Linux, Mac, Windows, Server, Cloud
Privacy
Your choice: run it on your device or use an online service
API key
Not needed

Try it

Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?

Before you install

  • Only download from the official GitHub page. Copies with similar names exist for many popular projects.
  • License (Apache-2.0): Permissive: free to use, change and share, including for business.
  • More on staying safe

Where people are talking about it