gpt4local
Enrichment pendingOpenai-style, fast & lightweight local language model inference w/ documents
GraphCanon updated today · GitHub synced today
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Dormant (847d since push)
- As of today
- Provenance
- Not a fork · Personal account
- As of today
- Security (OSV)
- No criticals
- As of today
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
pip install gpt4localSimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
Openai-style, fast & lightweight local language model inference w/ documents
Capability facts
- Languages
- python
Source: github.language · Jul 15, 2026
Categories
Compatibility
Sourced claims from the README excerpt - not unsourced marketing copy.
Source: README excerpt (regex_v1, Jul 15, 2026)
To use G4L, you need to have the llama.cpp Python bindings installed. You can install them using pip:Source link
Tags
README
Requirements
To use G4L, you need to have the llama.cpp Python bindings installed. You can install them using pip:
pip3 install -U llama-cpp-python
Installation
- Clone the G4L repository:
git clone https://github.com/gpt4free/gpt4local
- Navigate to the cloned directory:
cd gpt4local
- Install the required dependencies:
pip install -r requirements.txt
For agents
This page has a .md twin and JSON over the API.