private-gpt logo

private-gpt

zylon-ai/private-gpt

Complete API layer for private AI applications on local models

GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026

68views this month

57k stars7.6k forksLast push Sep 7, 2026 Python Apache-2.0

Decision brief

PrivateGPT provides a comprehensive API layer to build private, on-premise AI applications leveraging local OpenAI-compatible inference servers. It offers features such as RAG, skills, tools, text-to-SQL functionalities,

Good fit when

  • - You need to deploy and operationalize your own locally-run models without relying on cloud APIs.
  • - Your application requires a high degree of customization beyond what existing cloud services offer.

Avoid when

  • - You prefer simplicity and ease-of-use over full control; PrivateGPT requires more setup than using direct cloud-based AI services.
  • - Your project does not involve running models locally but strictly relies on public cloud resources for inference server operations.
Requirements:
Min 8 GB RAM; Requires Docker

Observed Jul 11, 2026 · Source: enrich:decision_facts

Verify the decision

Maintenance and security

Full trust report
Maintenance
Very active (0d since push)
As of Sep 8, 2026
Provenance
Not a fork · Organization account
As of Sep 8, 2026
Security (OSV)
No lockfile
As of Jul 11, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

pip install private-gpt
PyPI

How it fits your stack(5)

Typed graph edges - alternatives, integrations, successors, and dependencies. Ranked by relationship type, not raw GitHub stars.

Relationship graph

Optional deeper exploration of typed edges and category neighbours.

Similar tools

Same-category neighbours not already linked as typed edges.

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

PrivateGPT offers an open-source API that interfaces with OpenAI-compatible inference servers to build private, on-premise AI applications. It provides RAG, skills, tools, text-to-SQL functionalities among others.

Capability facts

Deploy
Self-host

Source: dockerfile:Dockerfile · Sep 8, 2026

Docker
Dockerfile present

Source: dockerfile:Dockerfile · Sep 8, 2026

CLI
CLI entrypoint

Source: pyproject.toml:[project.scripts] · Sep 8, 2026

Languages
python

Source: github.language+pyproject.toml · Sep 8, 2026

Categories

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Anthropic APIAnthropic API

Source: README excerpt (regex_v1, Sep 8, 2026)

tp://localhost:8080/ui). The API is at `http://localhost:8080` and follows the [Anthropic API](https://docs.privategpt.dev/api-reference/api-reference) spec.
Source link
Python runtimePython

Source: README excerpt (regex_v1, Sep 8, 2026)

uv tool install --python 3.11 \
Source link

Tags

README

<div align="center" PrivateGPT is the open source API layer that turns local models into production AI applications. <a href="https://trendshift.io/repositories/8691" target=" blank" <img src="https://trendshift.io/api/badge/repositories/8691" alt="zylon ai%2Fprivate gpt Trendshi...

For agents

This page has a .md twin and JSON over the API.

Was this helpful?

Anonymous feedback helps us improve pages and translations.