TurboLLM logo

TurboLLM

mohitsoni48/TurboLLM

Run any local LLM engine auto-tuned to your GPU with polished web UI and OpenAI/Anthropic-compatible API

GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026

274 stars38 forksLast push Sep 19, 2026 TypeScript

Decision brief

Unverified catalog guidance: TurboLLM offers local LLM execution optimized for GPU performance with a polished web UI and APIs compatible with OpenAI/Anthropic.

Good fit when

  • Unverified catalog guidance: When you want to self-host an LLM service without external dependencies on Electron or Python.
  • Unverified catalog guidance: For scenarios where offline operation is necessary, ensuring dependency-free access to local LLM engines optimized for GPU.

Avoid when

  • Unverified catalog guidance: If your setup does not include a GPU as TurboLLM primarily optimizes performance specifically for that hardware.
  • Unverified catalog guidance: When you require heavy model training capabilities on the same platform; TurboLLM focuses more on running and inference tasks with LLMs.

Observed Jul 17, 2026 · Source: enrich:decision_facts

Verify the decision

Maintenance and security

Full trust report
Maintenance
Very active (0d since push)
As of Sep 20, 2026
Provenance
Not a fork · Personal account
As of Sep 20, 2026
Security (OSV)
No lockfile
As of Jul 15, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

Package installation is not established from the available documentation. Check the source repository for setup instructions.

git clone https://github.com/mohitsoni48/turbollm
Source repository

Relationship proposals(4)

Relationship types and rationales are stored proposals, not independently verified integrations, migration guidance or endorsements.

Relationship graph

Optional deeper exploration of typed edges and category neighbours.

Relationship types and rationales are stored proposals, not independently verified integrations, migration guidance or endorsements.

Similar tools

Same-category neighbours not already linked as typed edges.

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

TurboLLM provides an efficient and user-friendly way to run local large language model engines optimized for GPU performance, featuring a clean web interface and APIs compatible with major LLM services. It supports self-hosting without dependencies on Electron or Python.

Capability facts

MCP server
Unknown; MCP server not established by this scan

Source: repo_scan · Sep 20, 2026

Languages
typescript, javascript

Source: github.language+package.json · Sep 20, 2026

Categories

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Node.js runtimeNode.js

Source: README excerpt (regex_v1, Sep 20, 2026)

- **Node.js 22.13.0 or newer** — enforced at startup with a clear message.
Source link

Tags

README

or install globally npm install g turbollm turbollm `` llama server /onboarding winget install OpenJS.NodeJS.LTS brew install node node version PATH npx turbollm npx turbollm llama server Dockerfile. docker compose .yaml FSL 1.1 ALv2` . Full text: LICENSE.md. License FAQ (plain l...

For agents

This page has a .md twin and JSON over the API.

Was this helpful?

Anonymous feedback helps us improve pages and translations.