What it does
ncnn is software that runs already-trained AI models efficiently, a job called "inference". It is designed for phones, embedded gadgets and desktops, and has no outside dependencies, which keeps it small.
It works on many platforms, including Android, iOS, Windows, macOS, Linux, Raspberry Pi and web browsers, and can use either the main processor or the graphics chip. A companion tool converts models made with popular frameworks like PyTorch into ncnn's format.
Its makers say it is used in many Tencent apps, such as WeChat and QQ.
Who it's for
App developers who want to put AI features inside mobile or desktop apps without relying on the cloud.
Can I use it without coding?
Developers only. It's a programming library for C++ and Python developers. New to this? Start here.
Can I run it?
- Cost
- FreeNothing to pay or sign up for.
- Runs on
- Phone, Windows, Mac, Linux, Web browser
- Computer
- An ordinary computer is fine
- Privacy
- Runs on your own device: your data stays with you
- API key
- Not needed
Try it
Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?
Before you install
- Only download from the official GitHub page or the official download page above. Copies with similar names exist for many popular projects.
- No standard license listed. Check the GitHub page before using it for business.
- More on staying safe