gpt4local logo

gpt4local

xtekky/gpt4local

Openai-style fast lightweight local language model inference with documents

GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026

146 stars32 forksLast push Mar 19, 2024 Python

Decision brief

Unverified catalog guidance: gpt4local offers fast lightweight local language model inference with documents similar to OpenAI models but hosts the functionality locally.

Good fit when

  • Unverified catalog guidance: Need fast inference times in a low-latency environment
  • Unverified catalog guidance: Require complete control over data privacy and security

Avoid when

  • Unverified catalog guidance: Desire frequent access to latest model updates without manual intervention
  • Unverified catalog guidance: In need of high-end feature support offered by cloud-based services
Requirements:
Depends on llama.cpp Python bindings

Observed Jul 17, 2026 · Source: enrich:decision_facts

Verify the decision

Maintenance and security

Full trust report
Maintenance
Dormant (914d since push)
As of Sep 20, 2026
Provenance
Not a fork · Personal account
As of Sep 20, 2026
Security (OSV)
No published findings
As of Jul 15, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

Package installation is not established from the available documentation. Check the source repository for setup instructions.

git clone https://github.com/xtekky/gpt4local
Source repository

Relationship proposals(1)

Relationship types and rationales are stored proposals, not independently verified integrations, migration guidance or endorsements.

Relationship graph

Optional deeper exploration of typed edges and category neighbours.

Relationship types and rationales are stored proposals, not independently verified integrations, migration guidance or endorsements.

Similar tools

Same-category neighbours not already linked as typed edges.

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

A repository that provides OpenAI-like chatbot functionalities using locally hosted language models for fast and lightweight inference.

Capability facts

Languages
python

Source: github.language · Sep 20, 2026

Categories

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Python runtimePython

Source: README excerpt (regex_v1, Sep 20, 2026)

To use G4L, you need to have the llama.cpp Python bindings installed. You can install them using pip:
Source link

Tags

README

Requirements To use G4L, you need to have the llama.cpp Python bindings installed. You can install them using pip: Installation 1. Clone the G4L repository: 2. Navigate to the cloned directory: 3. Install the required dependencies:

For agents

This page has a .md twin and JSON over the API.

Was this helpful?

Anonymous feedback helps us improve pages and translations.