What it does
When an AI labels a photo, it is hard to know why. This library draws heat maps over the image that highlight the areas the AI paid most attention to.
It works with many kinds of image AI and includes many explanation methods, plus ways to check whether an explanation can be trusted.
Who it's for
Developers and researchers who build or check image-recognition AI.
Can I use it without coding?
Developers only. It is a Python library used in your own code. New to this? Start here.
Can I run it?
- Cost
- FreeNothing to pay or sign up for.
- Privacy
- Runs on your own device: your data stays with you
- API key
- Not needed
Try it
Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?
Before you install
- Only download from the official GitHub page. Copies with similar names exist for many popular projects.
- License (MIT): Very permissive: free to use, change and share, including for business.
- More on staying safe