What it does
Different AI models are good at different things. The Semantic Router sits between an AI app and many models, and for each request chooses or combines models according to your policy.
You can set priorities such as quality, speed or cost, and keep requests within approved places, whether local machines, private servers or the cloud. The project also publishes its own routing models and research.
Who it's for
Teams running AI apps or agents that use several models.
Can I use it without coding?
Developers only. It's server software that needs technical setup. New to this? Start here.
Can I run it?
- Cost
- FreeNothing to pay or sign up for.
- Runs on
- Server
- Computer
- Made for servers or data centres
- Privacy
- Your choice: run it on your device or use an online service
- API key
- Not needed
Try it
Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?
Before you install
- Only download from the official GitHub page. Copies with similar names exist for many popular projects.
- License (Apache-2.0): Permissive: free to use, change and share, including for business.
- More on staying safe
Where people are talking about it
- When to Reason: Semantic Router for vLLMResearch paper · Oct 2025
- Category-Aware Semantic Caching for Heterogeneous LLM WorkloadsResearch paper · Oct 2025