ggrun
Auto-tuned launcher for GGUF models on llama.cpp with OpenAI-compatible server
GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026
Decision brief
Unverified catalog guidance: ggrun, an auto-tuned launcher for GGUF models using llama.cpp, offers OpenAI-compatible server support with multi-GPU tensor-split and MoE expert placement capabilities.
Good fit when
- Unverified catalog guidance: When developing systems that require automatic hardware optimization and tuning for GGUF models on multiple GPUs
- Unverified catalog guidance: If you need a deployment method that supports OpenAI compatible APIs while offering crash recovery mechanisms
Avoid when
- Unverified catalog guidance: For environments where single-GPU setups are preferred, as ggrun specializes in multi-GPU configurations and may offer limited advantage or additional complexity
- Unverified catalog guidance: When you do not require auto-tuning capabilities for hardware performance optimization since this feature is specific to ggrun
- Pricing:
- freemium - Free to use under MIT license; no direct costs involved in usage.
Observed Jul 17, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Very active (0d since push)
- As of Sep 20, 2026
- Provenance
- Not a fork · Personal account
- As of Sep 20, 2026
- Security (OSV)
- No lockfile
- As of Jul 15, 2026
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
Package installation is not established from the available documentation. Check the source repository for setup instructions.
git clone https://github.com/raketenkater/ggrunSource repositoryRelationship proposals(1)
Relationship types and rationales are stored proposals, not independently verified integrations, migration guidance or endorsements.
Relationship graph
Optional deeper exploration of typed edges and category neighbours.
Relationship types and rationales are stored proposals, not independently verified integrations, migration guidance or endorsements.
Similar tools
Same-category neighbours not already linked as typed edges.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
Offers auto-tuning capabilities and an OpenAI-compatible server for GGUF models leveraging llama.cpp, supports multi-GPU tensor-split and MoE expert placement.
Capability facts
- Languages
- go
Source: github.language · Sep 20, 2026
Categories
Tags
README
Quick start Linux / macOS: Windows (PowerShell): Open a new terminal after adding ggrun to PATH. To launch immediately with the standard install location, use on Linux or in PowerShell. Then run a local GGUF, download one from Hugging Face, or open the TUI: ```bash ggrun model.gg...
For agents
This page has a .md twin and JSON over the API.