GraphCanon updated 2w · GitHub synced 2w · 33 views this month
Decision brief
Semantic caching tool for LLMs, integrates with LangChain and llama_index.
Good fit when
- You need vector search capabilities integrated directly into your caching mechanism using Milvus or Redis.
- Integrated solutions are preferred for reducing the overhead of connecting separate components.
Avoid when
- Your application strictly requires a non-Python environment as GPTCache is Python-specific.
- If you seek minimal dependencies and manual setup; GPTCache installs additional libraries automatically based on usage.
Observed Jul 12, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Dormant (392d since push)
- As of 2w
- Provenance
- Not a fork · Organization account
- As of 2w
- Security (OSV)
- No criticals
- As of 1mo
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Backing
Company context for Zilliz. Display-only - separate from trust and ranking.
- Company
- Zilliz·GitHub org profile·1mo
- Funding
- $60,000,000 (2022-08)·GraphCanon curated seed (public press)·1mo
- Commercial model
- Open core·GraphCanon curated seed·1mo
Install
pip install GPTCacheSimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
GPTCache is a semantic caching tool designed specifically for Large Language Models (LLMs), integrated with frameworks like LangChain and llama_index, to enhance efficiency by storing query results based on their semantic similarity. It supports various Python libraries including Redis and Milvus for advanced functionalities such as vector search.
Capability facts
- Languages
- python
Source: github.language · Aug 8, 2026
Categories
Graph entities
Compatibility
Sourced claims from the README excerpt - not unsourced marketing copy.
Source: README excerpt (regex_v1, Aug 8, 2026)
- Make sure that the Python version is **3.8.1 or higher**, check: `python --version`Source link
Tags
README
😊 Quick Start
Note:
- You can quickly try GPTCache and put it into a production environment without heavy development. However, please note that the repository is still under heavy development.
- By default, only a limited number of libraries are installed to support the basic cache functionalities. When you need to use additional features, the related libraries will be automatically installed.
- Make sure that the Python version is 3.8.1 or higher, check:
python --version - If you encounter issues installing a library due to a low pip version, run:
python -m pip install --upgrade pip.
install the repo
pip install -r requirements.txt python setup.py install
For agents
This page has a .md twin and JSON over the API.