What it does
MNN is a deep-learning framework designed to run AI models on devices, such as phones, PCs and small embedded gadgets, rather than in the cloud. Its makers say it is used in many Alibaba apps.
MNN-LLM uses it to run large language models locally, and MNN-Diffusion does the same for Stable Diffusion image models. The project also offers chat apps for Android and iOS built on it, plus an offline 3D avatar you can talk to.
It's small and works with models from other popular AI toolkits.
Who it's for
App developers who want AI to run on-device, and people interested in offline AI on their phone.
Can I use it without coding?
Developers only. Mainly a toolkit for programmers, though the project also publishes mobile chat apps built with it. New to this? Start here.
Can I run it?
- Cost
- FreeNothing to pay or sign up for.
- Runs on
- Phone
- Computer
- An ordinary computer is fine
- Privacy
- Runs on your own device: your data stays with you
- API key
- Not needed
Try it
- To try it without coding, install the MNN Chat app for Android from the project's app releases.
Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?
Before you install
- Only download from the official GitHub page. Copies with similar names exist for many popular projects.
- License (Apache-2.0): Permissive: free to use, change and share, including for business.
- More on staying safe