Alternatives hub · graph-backed

llama.cpp alternatives

Not a popularity vote. Each is a typed edge from llama.cpp with the reason it exists in Inference & Serving - ranked with live GitHub stats, not marketing.

ConstraintsAll Go HTML Java JavaScript Jupyter Notebook MDX Python Rust TypeScript3 of 24 match

rtk

CLI proxy reducing LLM token consumption by 60-90%

Rustinference-serving

69k

stars

llmfit

Hundreds of models & providers. One command to find what runs on your hardware.

Rustinference-serving

29k

stars

chroma

Data infrastructure for AI

Rustinference-serving

29k

stars

Head-to-head comparisons

llama.cpp vs open-webuicompare →llama.cpp vs vllmcompare →llama.cpp vs rtkcompare →llama.cpp vs unslothcompare →llama.cpp vs anything-llmcompare →llama.cpp vs mem0compare →llama.cpp vs litellmcompare →llama.cpp vs LocalAIcompare →

llama.cpp alternatives

Head-to-head comparisons

Command menu