Alternatives hub · graph-backed

llama.cpp alternatives

Not a popularity vote. Each is a typed edge from llama.cpp with the reason it exists in Inference & Serving - ranked with live GitHub stats, not marketing.

ConstraintsAll Go HTML Java JavaScript Jupyter Notebook MDX Python Rust TypeScript1 of 24 match

LocalAI

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

Goinference-serving

47k

stars

Head-to-head comparisons

llama.cpp vs open-webuicompare →llama.cpp vs vllmcompare →llama.cpp vs rtkcompare →llama.cpp vs unslothcompare →llama.cpp vs anything-llmcompare →llama.cpp vs mem0compare →llama.cpp vs litellmcompare →llama.cpp vs LocalAIcompare →

llama.cpp alternatives

Head-to-head comparisons

Command menu