What it does
Laya-MLX runs 'typed decision' models on Macs with Apple chips. Instead of writing text, the model picks an answer from options you define, such as which department should handle a support message.
Its makers report decisions in a few thousandths of a second on a high-end Mac. After the model is downloaded once, it works fully on your computer.
A small Snake game demo shows the model making a decision for every move.
Who it's for
Developers on Apple Silicon Macs who need quick, local sorting and decision-making.
Can I use it without coding?
Developers only. It is a Python library used in code. New to this? Start here.
Can I run it?
- Cost
- FreeNothing to pay or sign up for.
- Runs on
- Mac
- Computer
- Works best on a powerful computer or one with a graphics card (GPU)
- Privacy
- Runs on your own device: your data stays with you
- API key
- Not needed
Try it
Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?
Before you install
- Only download from the official GitHub page. Copies with similar names exist for many popular projects.
- License (Apache-2.0): Permissive: free to use, change and share, including for business.
- More on staying safe