Alternatives hub · graph-backed
llama.cpp alternatives
Not a popularity vote. Each is a typed edge from llama.cpp with the reason it exists in Inference & Serving - ranked with live GitHub stats, not marketing.
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
A high-throughput and memory-efficient inference and serving engine for LLMs
Unsloth Studio is a web UI for training and running open models locally.
Universal memory layer for AI Agents
Python SDK and Proxy Server for calling over 100 LLM APIs in OpenAI format
Unified framework for scaling AI and Python applications
Langchain-Chatchat is a local knowledge-based RAG and Agent application for LLMs like ChatGLM, Qwen and Llama.
Curriculum for building AI systems from scratch
Your AI second brain. Self-hostable.
SGLang high-performance serving framework
Repository listing free and trial-based LLM inference API resources
Build multimodal AI applications with cloud-native stack