{"data":{"slug":"zilliztech-gptcache","name":"GPTCache","tagline":"Semantic cache for LLMs, integrated with LangChain and llama_index.","github_url":"https://github.com/zilliztech/GPTCache","owner":"zilliztech","repo":"GPTCache","owner_avatar_url":"https://avatars.githubusercontent.com/u/18416694?v=4","primary_language":"Python","stars":8194,"forks":595,"topics":["aigc","autogpt","babyagi","chatbot","chatgpt","chatgpt-api","dolly","gpt","langchain","llama","llama-index","llm","memcache","milvus","openai","redis","semantic-search","similarity-search","vector-search"],"archived":false,"github_pushed_at":"2025-07-11T09:04:36+00:00","maintenance_label":"Dormant","stars_delta_30d":70,"url":"https://www.graphcanon.com/tools/zilliztech-gptcache","markdown_url":"https://www.graphcanon.com/tools/zilliztech-gptcache.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/zilliztech-gptcache","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=zilliztech-gptcache","description":"Semantic cache for LLMs. Fully integrated with LangChain and llama_index. ","homepage_url":"https://gptcache.readthedocs.io","license":"MIT","open_issues":99,"watchers":59,"ai_summary":"GPTCache provides a semantic caching solution for large language models, facilitating efficient reuse of previous computations and responses. It integrates seamlessly with LangChain and llama_index, offering a streamlined approach to caching in AI applications.","readme_excerpt":"## 😊 Quick Start\n\n**Note**:\n\n- You can quickly try GPTCache and put it into a production environment without heavy development. However, please note that the repository is still under heavy development.\n- By default, only a limited number of libraries are installed to support the basic cache functionalities. When you need to use additional features, the related libraries will be **automatically installed**.\n- Make sure that the Python version is **3.8.1 or higher**, check: `python --version`\n- If you encounter issues installing a library due to a low pip version, run: `python -m pip install --upgrade pip`.\n\n---\n\n# install the repo\npip install -r requirements.txt\npython setup.py install\n```","github_created_at":"2023-03-24T05:51:16+00:00","created_at":"2026-07-11T10:44:06.529456+00:00","updated_at":"2026-09-20T04:30:42.953914+00:00","categories":[{"slug":"data-retrieval","name":"Data & Retrieval","url":"https://www.graphcanon.com/categories/data-retrieval","markdown_url":"https://www.graphcanon.com/categories/data-retrieval.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/data-retrieval"},{"slug":"llm-frameworks","name":"LLM Frameworks","url":"https://www.graphcanon.com/categories/llm-frameworks","markdown_url":"https://www.graphcanon.com/categories/llm-frameworks.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/llm-frameworks"}],"tags":[{"slug":"aigc","name":"aigc"},{"slug":"autogpt","name":"autogpt"},{"slug":"babyagi","name":"babyagi"},{"slug":"chatbot","name":"chatbot"},{"slug":"chatgpt","name":"chatgpt"},{"slug":"chatgpt-api","name":"chatgpt-api"},{"slug":"dolly","name":"dolly"},{"slug":"gpt","name":"gpt"}],"trust":{"provenance":{"is_fork":false,"github_id":618276831,"owner_type":"Organization","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-09-18T08:25:31.175Z","maintenance":{"label":"Dormant","score":18,"methodology":"github_public_v1","releases_90d":0,"days_since_push":433,"last_release_at":"2024-08-01T11:25:55Z","stars_delta_30d":70,"open_issues_delta_30d":5},"security_summary":{"status":"ok","scanner":"osv@v1","low_count":0,"high_count":0,"last_scan_at":"2026-09-18T08:25:33.616Z","medium_count":0,"scan_profile":"deps","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-09-18T08:25:29.996Z"},"languages":{"value":["python"],"source":"github.language","observed_at":"2026-09-18T08:25:29.996Z"},"license_spdx":{"value":"MIT","source":"github.license","observed_at":"2026-09-18T08:25:29.996Z"}},"decision_facts":{"hosting":null,"pricing":{"model":"freemium","summary":"GPTCache is available under the MIT license, which is free to use for both personal and commercial projects. However, additional features may require the installation of specific libraries, which may,"},"requirements":{"notes":["Ensure Python version is 3.8.1 or higher.","Additional libraries are automatically installed as needed for extended functionality."],"min_ram_gb":2,"requires_docker":false},"constraints":{"min_ram_gb":2,"pricing_model":"freemium","requires_docker":false},"when_to_use":["When you are working with LangChain or llama_index and want to enhance the efficiency of your large language models by caching responses semantically.","If your application requires quick integration and minimal development effort to implement caching for large language models."],"when_not_to_use":["If your project does not involve LangChain or llama_index, as GPTCache's integration benefits are specific to these frameworks.","When you need a caching solution that supports a wide range of frameworks beyond LangChain and llama_index, as GPTCache's integration is limited to these specific tools."],"source":"enrich:decision_facts","observed_at":"2026-09-18T11:59:28.885Z"},"constraint_facets":{"min_ram_gb":2,"pricing_model":"freemium","requires_docker":false},"decision_summary":[{"label":"Pricing","value":"freemium - GPTCache is available under the MIT license, which is free to use for both personal and commercial projects. However, additional features may require the installation of specific libraries, which may,"},{"label":"Requirements","value":"Min 2 GB RAM; Ensure Python version is 3.8.1 or higher.; Additional libraries are automatically installed as needed for extended functionality."},{"label":"Adopt for","value":"GPTCache is a semantic caching solution for large language models, designed to integrate with LangChain and llama_index, aimed at improving efficiency by reusing previous computations and responses."}]}}