Plain-AyI
← All projects
Running AI at scale

WasmEdge

A small, fast engine for running sandboxed programs, which can also run open AI models on your devices.

Research-backedNew this week

What it does

WasmEdge runs programs written in WebAssembly, a compact format that runs safely in a sealed-off sandbox. It is used for cloud services, small edge devices and apps that embed small functions.

Its makers describe it as an easy way to run large language models on your own devices, through a companion framework called LlamaEdge that lets you chat with open-source models.

It can be managed with common cloud tools such as Docker and Kubernetes, and embedded inside apps written in Go, Rust or C.

Who it's for

Developers building cloud, edge or embedded software, including those who want to run AI models on small devices.

Can I use it without coding?

Developers only. It's a runtime installed and used from the command line or inside other software. New to this? Start here.

Can I run it?

Cost
FreeNothing to pay or sign up for.
Runs on
Server
Privacy
Runs on your own device: your data stays with you
API key
Not needed

Try it

Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?

Before you install

  • Only download from the official GitHub page. Copies with similar names exist for many popular projects.
  • License (Apache-2.0): Permissive: free to use, change and share, including for business.
  • More on staying safe

Where people are talking about it