GPTCache logo

GPTCache

zilliztech/GPTCache

Semantic cache for LLMs, integrated with LangChain and llama_index.

GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026

55views this month

8.2k stars595 forksLast push Jul 11, 2025 Python MIT

Decision brief

GPTCache is a semantic caching solution for large language models, designed to integrate with LangChain and llama_index, aimed at improving efficiency by reusing previous computations and responses.

Good fit when

  • When you are working with LangChain or llama_index and want to enhance the efficiency of your large language models by caching responses semantically.
  • If your application requires quick integration and minimal development effort to implement caching for large language models.

Avoid when

  • If your project does not involve LangChain or llama_index, as GPTCache's integration benefits are specific to these frameworks.
  • When you need a caching solution that supports a wide range of frameworks beyond LangChain and llama_index, as GPTCache's integration is limited to these specific tools.
Pricing:
freemium - GPTCache is available under the MIT license, which is free to use for both personal and commercial projects. However, additional features may require the installation of specific libraries, which may,
Requirements:
Min 2 GB RAM; Ensure Python version is 3.8.1 or higher.; Additional libraries are automatically installed as needed for extended functionality.

Observed Sep 18, 2026 · Source: enrich:decision_facts

Verify the decision

Maintenance and security

Full trust report
Maintenance
Dormant (433d since push)
As of Sep 18, 2026
Provenance
Not a fork · Organization account
As of Sep 18, 2026
Security (OSV)
No criticals
As of Sep 18, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Backing

Company context for Zilliz. Display-only - separate from trust and ranking.

Company
Zilliz·GitHub org profile·Jul 11, 2026
Funding
$60,000,000 (2022-08)·GraphCanon curated seed (public press)·Jul 11, 2026
Commercial model
Open core·GraphCanon curated seed·Jul 11, 2026

Install

pip install GPTCache
PyPI

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

GPTCache provides a semantic caching solution for large language models, facilitating efficient reuse of previous computations and responses. It integrates seamlessly with LangChain and llama_index, offering a streamlined approach to caching in AI applications.

Capability facts

Languages
python

Source: github.language · Sep 18, 2026

Categories

Graph entities

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Python runtimePython

Source: README excerpt (regex_v1, Sep 18, 2026)

- Make sure that the Python version is **3.8.1 or higher**, check: `python --version`
Source link

Tags

README

😊 Quick Start Note : You can quickly try GPTCache and put it into a production environment without heavy development. However, please note that the repository is still under heavy development. By default, only a limited number of libraries are installed to support the basic cach...

For agents

This page has a .md twin and JSON over the API.

Was this helpful?

Anonymous feedback helps us improve pages and translations.