Plain-AyI
← All projects
Running AI at scale

OpenLLMetry

Lets developers see what their AI app is doing behind the scenes, using standard monitoring tools.

New this week

What it does

When an app uses AI models, it helps to see each request, how long it took and what came back. OpenLLMetry adds this kind of tracking, called observability, to AI apps. It is built on OpenTelemetry, a widely used standard for monitoring software.

Because it uses that standard, the data can go to many existing monitoring services, such as Datadog, Grafana or New Relic. It is made by Traceloop, and it records calls to AI providers and vector databases.

Who it's for

Developers running AI apps in production who want to monitor and debug them.

Can I use it without coding?

Developers only. You add it to your own code with a couple of lines. New to this? Start here.

Can I run it?

Cost
FreeNothing to pay or sign up for.
Computer
An ordinary computer is fine
API key
Not needed

Try it

Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?

Before you install

  • Only download from the official GitHub page. Copies with similar names exist for many popular projects.
  • License (Apache-2.0): Permissive: free to use, change and share, including for business.
  • More on staying safe

Where people are talking about it