What it does
Vision Agents, from the company Stream, helps developers build AI agents that join live video calls, see what's on camera, listen and reply, with very little delay.
It can combine fast image-recognition models, such as YOLO, with AI models from OpenAI, Google Gemini, Anthropic and others. Examples include a golf coach, workout coaching and physical therapy.
It also supports phone calls, speech-to-text and text-to-speech services, searching your own documents, and memory across conversations. It uses Stream's video network by default but its makers say it works with others.
Who it's for
Developers building live video or voice AI apps, such as coaching, support or monitoring tools.
Can I use it without coding?
Developers only. It's a Python library and needs a Stream account and API key. New to this? Start here.
Can I run it?
- Cost
- Free, but needs an AI accountThe software is free, but it uses an online AI service (like OpenAI or Anthropic), which usually charges for use.
- Computer
- An ordinary computer is fine
- Privacy
- Sends what you give it to an online service
- API key
- Needed. An API key is a password-like code from an online AI service. What's that?
Try it
Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?
Before you install
- Only download from the official GitHub page. Copies with similar names exist for many popular projects.
- License (Apache-2.0): Permissive: free to use, change and share, including for business.
- Keep your API key private. Never paste it into websites or share it, and set a spending limit with the AI service.
- What you type or upload is sent to an online service. Avoid sharing private or sensitive information.
- More on staying safe