---
title: "llama.cpp vs LocalAI"
type: "comparison"
canonical_url: "https://www.graphcanon.com/compare/ggml-org-llama-cpp-vs-mudler-localai"
tools: ["ggml-org-llama-cpp", "mudler-localai"]
---

# llama.cpp vs LocalAI

Neutral, constraint-first comparison with live GitHub stats.

| | [llama.cpp](/tools/ggml-org-llama-cpp.md) | [LocalAI](/tools/mudler-localai.md) |
| --- | --- | --- |
| Tagline | LLM inference in C/C++ | LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required. |
| Stars | 119,588 | 47,394 |
| Forks | 20,314 | 4,215 |
| Open issues | 1,826 | 211 |
| Language | C++ | Go |
| License | MIT | MIT |
| Categories | Inference & Serving | AI Agents, Inference & Serving, LLM Frameworks |

---

**Machine-readable endpoints**

- JSON: [`/api/graphcanon/graph?tool=ggml-org-llama-cpp`](/api/graphcanon/graph?tool=ggml-org-llama-cpp)
- LLM index: [/llms.txt](/llms.txt)
- Full corpus: [/llms-full.txt](/llms-full.txt)

_GraphCanon - The knowledge graph for AI development. https://www.graphcanon.com/_