What it does
AgentOps helps developers watch and debug AI agents. With a couple of lines of code, it records every AI call an agent makes and shows the run as a step-by-step replay on a dashboard.
It tracks the cost of each AI provider, helps compare and test agents, and works with popular agent frameworks such as CrewAI, AutoGen, LangGraph and the OpenAI Agents SDK.
You can use the makers' online dashboard with an AgentOps key, or run the whole app on your own machine, since it is open source.
Who it's for
Developers building AI agents who need to see what went wrong and what it cost.
Can I use it without coding?
Developers only. Added to an agent's Python code; results appear in a web dashboard. New to this? Start here.
Can I run it?
- Runs on
- Cloud, Server
- Computer
- An ordinary computer is fine
- Privacy
- Your choice: run it on your device or use an online service
- API key
- Needed. An API key is a password-like code from an online AI service. What's that?
Try it
Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?
Before you install
- Only download from the official GitHub page. Copies with similar names exist for many popular projects.
- License (MIT): Very permissive: free to use, change and share, including for business.
- Keep your API key private. Never paste it into websites or share it, and set a spending limit with the AI service.
- More on staying safe