What it does
Text Embeddings Inference (TEI), from Hugging Face, is software for running embedding models as a service. Embeddings turn text into lists of numbers that capture meaning, which powers search by meaning and document question-answering.
It supports many popular open models, plus re-ranking models that sort search results and classification models. Its makers say it starts fast, uses small Docker images and groups requests for speed.
It runs on graphics cards, on regular processors and on Macs, and can work without an internet connection.
Who it's for
Engineers running search, RAG or other embedding-based features in production.
Can I use it without coding?
Developers only. It's server software usually run with Docker. New to this? Start here.
Can I run it?
- Cost
- FreeNothing to pay or sign up for.
- Runs on
- Server, Linux, Mac
- Computer
- Made for servers or data centres
- Privacy
- Runs on your own device: your data stays with you
- API key
- Not needed
Try it
Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?
Before you install
- Only download from the official GitHub page. Copies with similar names exist for many popular projects.
- License (Apache-2.0): Permissive: free to use, change and share, including for business.
- More on staying safe