Plain-AyI
← All projects
Running AI at scale

vLLM-Omni

Serves AI models that handle text, images, audio and video quickly to many users.

Research-backedNew this week

What it does

vLLM-Omni extends vLLM, a popular engine for running language models, to models that create or understand images, audio, video and robot actions.

It supports many open models, offers an OpenAI-compatible API and can spread work across many graphics cards.

Who it's for

Engineers deploying multimodal AI models for many users.

Can I use it without coding?

Developers only. It is server software for technical teams. New to this? Start here.

Can I run it?

Cost
FreeNothing to pay or sign up for.
Runs on
Server
Computer
Made for servers or data centres
Privacy
Runs on your own device: your data stays with you
API key
Not needed

Try it

Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?

Before you install

  • Only download from the official GitHub page. Copies with similar names exist for many popular projects.
  • License (Apache-2.0): Permissive: free to use, change and share, including for business.
  • More on staying safe

Where people are talking about it