Alternatives hub · graph-backed

llama.cpp alternatives

Not a popularity vote. Each is a typed edge from llama.cpp with the reason it exists in Inference & Serving - ranked with live GitHub stats, not marketing.

ConstraintsAll Go HTML Java JavaScript Jupyter Notebook MDX Python Rust TypeScript2 of 24 match

self-llm

《开源大模型食用指南》

Jupyter Notebookinference-serving

31k

stars

airllm

Repository for running large language models with reduced memory usage on limited GPU hardware.

Jupyter Notebookinference-serving

22k

stars

Head-to-head comparisons

llama.cpp vs open-webuicompare →llama.cpp vs vllmcompare →llama.cpp vs rtkcompare →llama.cpp vs unslothcompare →llama.cpp vs anything-llmcompare →llama.cpp vs mem0compare →llama.cpp vs litellmcompare →llama.cpp vs LocalAIcompare →

llama.cpp alternatives

Head-to-head comparisons

Command menu