What it does
NeMo Speech is a framework from NVIDIA for building speech AI. It covers turning speech into text (speech recognition), turning text into natural speech (text-to-speech), translating speech and recognising who is speaking.
NVIDIA also publishes ready-to-use models built with it, such as Parakeet and Canary for speech recognition and MagpieTTS for speech in many languages. Several have online demos.
It is designed for researchers and developers who train, adapt or run these models.
Who it's for
Researchers and developers working on voice and speech AI.
Can I use it without coding?
Developers only. Installed as a Python package and used from code. A graphics card is usually needed. New to this? Start here.
Can I run it?
- Cost
- FreeNothing to pay or sign up for.
- Computer
- Works best on a powerful computer or one with a graphics card (GPU)
- Privacy
- Runs on your own device: your data stays with you
- API key
- Not needed
Try it
Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?
Before you install
- Only download from the official GitHub page. Copies with similar names exist for many popular projects.
- License (Apache-2.0): Permissive: free to use, change and share, including for business.
- More on staying safe
Where people are talking about it
- CUDA 11.0Hacker News · Jul 2020
- CUDA Toolkit Release NotesHacker News · Nov 2019