gpt4local
Openai-style fast lightweight local language model inference with documents
GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026
Decision brief
Unverified catalog guidance: gpt4local offers fast lightweight local language model inference with documents similar to OpenAI models but hosts the functionality locally.
Good fit when
- Unverified catalog guidance: Need fast inference times in a low-latency environment
- Unverified catalog guidance: Require complete control over data privacy and security
Avoid when
- Unverified catalog guidance: Desire frequent access to latest model updates without manual intervention
- Unverified catalog guidance: In need of high-end feature support offered by cloud-based services
- Requirements:
- Depends on llama.cpp Python bindings
Observed Jul 17, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Dormant (914d since push)
- As of Sep 20, 2026
- Provenance
- Not a fork · Personal account
- As of Sep 20, 2026
- Security (OSV)
- No published findings
- As of Jul 15, 2026
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
Package installation is not established from the available documentation. Check the source repository for setup instructions.
git clone https://github.com/xtekky/gpt4localSource repositoryRelationship proposals(1)
Relationship types and rationales are stored proposals, not independently verified integrations, migration guidance or endorsements.
Relationship graph
Optional deeper exploration of typed edges and category neighbours.
Relationship types and rationales are stored proposals, not independently verified integrations, migration guidance or endorsements.
Similar tools
Same-category neighbours not already linked as typed edges.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
A repository that provides OpenAI-like chatbot functionalities using locally hosted language models for fast and lightweight inference.
Capability facts
- Languages
- python
Source: github.language · Sep 20, 2026
Categories
Compatibility
Sourced claims from the README excerpt - not unsourced marketing copy.
Source: README excerpt (regex_v1, Sep 20, 2026)
To use G4L, you need to have the llama.cpp Python bindings installed. You can install them using pip:Source link
Tags
README
Requirements To use G4L, you need to have the llama.cpp Python bindings installed. You can install them using pip: Installation 1. Clone the G4L repository: 2. Navigate to the cloned directory: 3. Install the required dependencies:
For agents
This page has a .md twin and JSON over the API.