ggrun

Enrichment pending

Auto-tuned launcher for GGUF models on llama.cpp / ik_llama.cpp, OpenAI-compatible server with multi-GPU tensor-split, MoE expert placement, measured flag tuning (AI Tune), hardware-matched HuggingFac

GitHub

GraphCanon updated today · GitHub synced today

254 stars14 forksLast push today Go MIT

ggrun alternatives Trust report

Verify the decision

Maintenance and security

Full trust report

Maintenance: Very active (0d since push); As of today
Provenance: Not a fork · Personal account; As of today
Security (OSV): No lockfile; As of today

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

go get github.com/raketenkater/ggrun

pkg.go.dev

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

AutoGPT

AutoGPT is the vision of accessible AI for everyone, to use and to build on.

185k★

ollama

Get up and running with various large language models using Ollama.

176k★

prompts.chat

Share, discover, and collect prompts from the community

165k★

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

Auto-tuned launcher for GGUF models on llama.cpp / ik_llama.cpp — OpenAI-compatible server with multi-GPU tensor-split, MoE expert placement, measured flag tuning (AI Tune), hardware-matched HuggingFace downloads, and crash recovery. An Ollama alternative for multi-GPU rigs.

Capability facts

Languages: go
Source: github.language · Jul 15, 2026

For agents

This page has a .md twin and JSON over the API.

/tools/raketenkater-ggrun.md GET /api/graphcanon/tools/raketenkater-ggrun GET /api/graphcanon/graph?tool=raketenkater-ggrun