What it does
GPTCache stores responses from AI language models. When a similar question comes in, it returns the saved answer, which its makers say cuts cost and speeds things up.
It works with LangChain and other tools. The README says it no longer adds support for new model APIs and points to its general get-and-set functions instead.
Who it's for
Developers running AI apps with many repeated questions.
Can I use it without coding?
Developers only. It is a Python library. New to this? Start here.
Can I run it?
- Cost
- FreeNothing to pay or sign up for.
- API key
- Not needed
Try it
Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?
Before you install
- Only download from the official GitHub page. Copies with similar names exist for many popular projects.
- License (MIT): Very permissive: free to use, change and share, including for business.
- More on staying safe
Where people are talking about it
- GPTCache: Slash Your LLM API Costs by 10xHacker News · Apr 2023