ggrun logo

ggrun

raketenkater/ggrun

Auto-tuned launcher for GGUF models on llama.cpp with OpenAI-compatible server

GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026

275 stars18 forksLast push Sep 19, 2026 Go MIT

Decision brief

Unverified catalog guidance: ggrun, an auto-tuned launcher for GGUF models using llama.cpp, offers OpenAI-compatible server support with multi-GPU tensor-split and MoE expert placement capabilities.

Good fit when

  • Unverified catalog guidance: When developing systems that require automatic hardware optimization and tuning for GGUF models on multiple GPUs
  • Unverified catalog guidance: If you need a deployment method that supports OpenAI compatible APIs while offering crash recovery mechanisms

Avoid when

  • Unverified catalog guidance: For environments where single-GPU setups are preferred, as ggrun specializes in multi-GPU configurations and may offer limited advantage or additional complexity
  • Unverified catalog guidance: When you do not require auto-tuning capabilities for hardware performance optimization since this feature is specific to ggrun
Pricing:
freemium - Free to use under MIT license; no direct costs involved in usage.

Observed Jul 17, 2026 · Source: enrich:decision_facts

Verify the decision

Maintenance and security

Full trust report
Maintenance
Very active (0d since push)
As of Sep 20, 2026
Provenance
Not a fork · Personal account
As of Sep 20, 2026
Security (OSV)
No lockfile
As of Jul 15, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

Package installation is not established from the available documentation. Check the source repository for setup instructions.

git clone https://github.com/raketenkater/ggrun
Source repository

Relationship proposals(1)

Relationship types and rationales are stored proposals, not independently verified integrations, migration guidance or endorsements.

Relationship graph

Optional deeper exploration of typed edges and category neighbours.

Relationship types and rationales are stored proposals, not independently verified integrations, migration guidance or endorsements.

Similar tools

Same-category neighbours not already linked as typed edges.

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

Offers auto-tuning capabilities and an OpenAI-compatible server for GGUF models leveraging llama.cpp, supports multi-GPU tensor-split and MoE expert placement.

Capability facts

Languages
go

Source: github.language · Sep 20, 2026

Categories

Tags

README

Quick start Linux / macOS: Windows (PowerShell): Open a new terminal after adding ggrun to PATH. To launch immediately with the standard install location, use on Linux or in PowerShell. Then run a local GGUF, download one from Hugging Face, or open the TUI: ```bash ggrun model.gg...

For agents

This page has a .md twin and JSON over the API.

Was this helpful?

Anonymous feedback helps us improve pages and translations.