txtai combines semantic search, language-model orchestration and AI workflows in an open-source framework.
Open source
24 alternativesGPTCache
GPTCache provides semantic caching for large language models and integrates with LangChain and LlamaIndex.
About GPTCache
GPTCache is a Python library for creating a semantic cache that stores LLM responses. It supports exact-match caching for repeated questions and similar-match caching for related queries, and integrates with LangChain and LlamaIndex. It also provides a get and set API and a server Docker image.
The repository is under heavy development and its API may change. It requires Python 3.8.1 or higher, and the maintainers state they no longer add support for new APIs or models.
Key features
- Stores LLM responses in a semantic cache
- Supports exact-match caching for repeated queries
- Supports similar-match caching for related queries
- Integrates with LangChain and LlamaIndex
- Provides get and set API for custom use
- Provides server Docker image for other languages
Best for: Python developers building LLM applications with LangChain or LlamaIndex who need response caching.
Good for
- Can be tried and put into production without heavy development
- Related libraries install automatically when additional features are needed
- Server Docker image allows use from languages other than Python
Watch out for
- API may change because the project is under heavy development
- No longer adds support for new APIs or models
- Requires Python 3.8.1 or higher
GPTCache at a glance
- Type
- Open-source project
- Pricing
- Not confirmed. Check the site
- Open source
- Yes · Source code
- Language
- English
- Last checked
- Oct 6, 2026 · Online when checked
- Listed
- Oct 5, 2026
GPTCache alternatives
Tools and sites you could use instead, ranked by how closely they match.
Pathway offers cloud templates for RAG, AI pipelines, and enterprise search that stay synchronized with connected data sources.
Open source
24 alternatives
OpenLLMetry provides OpenTelemetry-based observability for generative AI and large language model applications.
Open source
24 alternatives
OneCompression is a Python package for compressing large language models.
Open source
24 alternatives
This repository describes technologies for enabling AI capabilities with large and multimodal language models.
Open source
24 alternatives
LlamaIndex processes documents for AI applications and provides developer documentation and integrations.
Open source
24 alternativesPopular in AI Infrastructure & MLOps
Well-known listings from the same topic.
Guild AIguild.aiFlow AIflow-ai.comsystemprompt.iosystemprompt.ioKili Technologykili-technology.comAPI docsdocs.x.aiEyePop.aieyepop.ai
GPTCache FAQ
How do I install GPTCache?
Run pip install gptcache with Python 3.8.1 or higher installed.
Does GPTCache work with LangChain and LlamaIndex?
Yes, it is described as fully integrated with LangChain and llama_index.
How should I use GPTCache with new models or APIs?
The maintainers encourage using the get and set API in gptcache.
Is something wrong or out of date?
Tell us and an editor will check it.
Own this website?
Claim this listing
Claim the listing and suggest updates yourself. An editor checks every claim first.