Plain-AyI
← All projects
Running AI at scale

ONNX Runtime

Makes trained AI models run faster on many kinds of computers and chips.

What it does

ONNX Runtime is an engine for running trained AI models efficiently. It works with models from popular toolkits like PyTorch, TensorFlow and scikit-learn, and runs on many operating systems and types of hardware, using special chips where available.

It can also speed up training of some models on NVIDIA graphics cards. Its makers note it may collect usage data and send it to Microsoft.

Who it's for

Developers and companies putting AI models into apps and services.

Can I use it without coding?

Developers only. A software library used from code. New to this? Start here.

Can I run it?

Cost
FreeNothing to pay or sign up for.
API key
Not needed

Try it

Official download page

Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?

Before you install

  • Only download from the official GitHub page or the official download page above. Copies with similar names exist for many popular projects.
  • License (MIT): Very permissive: free to use, change and share, including for business.
  • More on staying safe

Where people are talking about it