TurboLLM
Run any local LLM engine auto-tuned to your GPU with polished web UI and OpenAI/Anthropic-compatible API
GraphCanon updated Aug 13, 2026 · GitHub synced Aug 13, 2026
44views this month
Decision brief
TurboLLM offers local LLM execution optimized for GPU performance with a polished web UI and APIs compatible with OpenAI/Anthropic.
Good fit when
- When you want to self-host an LLM service without external dependencies on Electron or Python.
- For scenarios where offline operation is necessary, ensuring dependency-free access to local LLM engines optimized for GPU.
Avoid when
- If your setup does not include a GPU as TurboLLM primarily optimizes performance specifically for that hardware.
- When you require heavy model training capabilities on the same platform; TurboLLM focuses more on running and inference tasks with LLMs.
Observed Jul 17, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Very active (1d since push)
- As of Aug 13, 2026
- Provenance
- Not a fork · Personal account
- As of Aug 13, 2026
- Security (OSV)
- No lockfile
- As of Jul 15, 2026
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
npm install TurboLLMHow it fits your stack(4)
Typed graph edges - alternatives, integrations, successors, and dependencies. Ranked by relationship type, not raw GitHub stars.
Alternative
Relationship graph
Optional deeper exploration of typed edges and category neighbours.
Similar tools
Same-category neighbours not already linked as typed edges.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
TurboLLM provides an efficient and user-friendly way to run local large language model engines optimized for GPU performance, featuring a clean web interface and APIs compatible with major LLM services. It supports self-hosting without dependencies on Electron or Python.
Capability facts
- MCP server
- No MCP server detected
Source: repo_scan · Aug 13, 2026
- Languages
- typescript, javascript
Source: github.language+package.json · Aug 13, 2026
Categories
Compatibility
Sourced claims from the README excerpt - not unsourced marketing copy.
Source: README excerpt (regex_v1, Aug 13, 2026)
- **Node.js 22.13.0 or newer** — enforced at startup with a clear message.Source link
Tags
README
or install globally npm install g turbollm turbollm `` llama server /onboarding winget install OpenJS.NodeJS.LTS brew install node node version PATH npx turbollm llama server Dockerfile. docker compose .yaml FSL 1.1 ALv2` . Full text: LICENSE.md. License FAQ (plain language summa...
For agents
This page has a .md twin and JSON over the API.