{"data":{"slug":"zilliztech-gptcache","name":"GPTCache","tagline":"Semantic cache for LLMs.","github_url":"https://github.com/zilliztech/GPTCache","owner":"zilliztech","repo":"GPTCache","owner_avatar_url":"https://avatars.githubusercontent.com/u/18416694?v=4","primary_language":"Python","stars":8124,"forks":589,"topics":["aigc","autogpt","babyagi","chatbot","chatgpt","chatgpt-api","dolly","gpt","langchain","llama","llama-index","llm","memcache","milvus","openai","redis","semantic-search","similarity-search","vector-search"],"archived":false,"github_pushed_at":"2025-07-11T09:04:36+00:00","maintenance_label":"Dormant","url":"https://www.graphcanon.com/tools/zilliztech-gptcache","markdown_url":"https://www.graphcanon.com/tools/zilliztech-gptcache.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/zilliztech-gptcache","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=zilliztech-gptcache","description":"Semantic cache for LLMs. Fully integrated with LangChain and llama_index. ","homepage_url":"https://gptcache.readthedocs.io","license":"MIT","open_issues":94,"watchers":57,"ai_summary":"GPTCache is a semantic caching tool designed specifically for Large Language Models (LLMs), integrated with frameworks like LangChain and llama_index, to enhance efficiency by storing query results based on their semantic similarity. It supports various Python libraries including Redis and Milvus for advanced functionalities such as vector search.","readme_excerpt":"## 😊 Quick Start\n\n**Note**:\n\n- You can quickly try GPTCache and put it into a production environment without heavy development. However, please note that the repository is still under heavy development.\n- By default, only a limited number of libraries are installed to support the basic cache functionalities. When you need to use additional features, the related libraries will be **automatically installed**.\n- Make sure that the Python version is **3.8.1 or higher**, check: `python --version`\n- If you encounter issues installing a library due to a low pip version, run: `python -m pip install --upgrade pip`.\n\n---\n\n# install the repo\npip install -r requirements.txt\npython setup.py install\n```","github_created_at":"2023-03-24T05:51:16+00:00","created_at":"2026-07-11T10:44:06.529456+00:00","updated_at":"2026-08-08T06:03:28.669479+00:00","categories":[{"slug":"evaluation-observability","name":"Evaluation & Observability","url":"https://www.graphcanon.com/categories/evaluation-observability","markdown_url":"https://www.graphcanon.com/categories/evaluation-observability.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/evaluation-observability"},{"slug":"inference-serving","name":"Inference & Serving","url":"https://www.graphcanon.com/categories/inference-serving","markdown_url":"https://www.graphcanon.com/categories/inference-serving.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/inference-serving"}],"tags":[{"slug":"aigc","name":"aigc"},{"slug":"autogpt","name":"autogpt"},{"slug":"babyagi","name":"babyagi"},{"slug":"chatbot","name":"chatbot"},{"slug":"langchain","name":"langchain"},{"slug":"llama-index","name":"llama-index"},{"slug":"semantic-search","name":"semantic-search"},{"slug":"similarity-search","name":"similarity-search"}],"trust":{"provenance":{"is_fork":false,"github_id":618276831,"owner_type":"Organization","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-08-08T06:03:27.803Z","maintenance":{"label":"Dormant","score":18,"methodology":"github_public_v1","releases_90d":0,"days_since_push":392,"last_release_at":"2024-08-01T11:25:55Z"},"security_summary":{"status":"ok","scanner":"osv@v1","low_count":0,"high_count":0,"last_scan_at":"2026-07-11T10:44:08.169Z","medium_count":0,"scan_profile":"deps","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-08-08T06:03:28.267Z"},"languages":{"value":["python"],"source":"github.language","observed_at":"2026-08-08T06:03:28.267Z"},"license_spdx":{"value":"MIT","source":"github.license","observed_at":"2026-08-08T06:03:28.267Z"}},"decision_facts":{"hosting":null,"pricing":null,"requirements":null,"constraints":null,"when_to_use":["You need vector search capabilities integrated directly into your caching mechanism using Milvus or Redis.","Integrated solutions are preferred for reducing the overhead of connecting separate components."],"when_not_to_use":["Your application strictly requires a non-Python environment as GPTCache is Python-specific.","If you seek minimal dependencies and manual setup; GPTCache installs additional libraries automatically based on usage."],"source":"enrich:decision_facts","observed_at":"2026-07-12T10:40:49.908Z"},"constraint_facets":null,"decision_summary":[{"label":"Adopt for","value":"Semantic caching tool for LLMs, integrates with LangChain and llama_index."}]}}