---
title: "litellm vs llama.cpp"
type: "comparison"
canonical_url: "https://www.graphcanon.com/compare/berriai-litellm-vs-ggml-org-llama-cpp"
tools: ["berriai-litellm", "ggml-org-llama-cpp"]
---

# litellm vs llama.cpp

Neutral, constraint-first comparison with live GitHub stats.

| | [litellm](/tools/berriai-litellm.md) | [llama.cpp](/tools/ggml-org-llama-cpp.md) |
| --- | --- | --- |
| Tagline | Python SDK and Proxy Server for calling over 100 LLM APIs in OpenAI format | LLM inference in C/C++ |
| Stars | 52,899 | 119,588 |
| Forks | 9,548 | 20,314 |
| Open issues | 3,711 | 1,826 |
| Language | Python | C++ |
| License | Other | MIT |
| Categories | Inference & Serving, LLM Frameworks | Inference & Serving |

---

**Machine-readable endpoints**

- JSON: [`/api/graphcanon/graph?tool=berriai-litellm`](/api/graphcanon/graph?tool=berriai-litellm)
- LLM index: [/llms.txt](/llms.txt)
- Full corpus: [/llms-full.txt](/llms-full.txt)

_GraphCanon - The knowledge graph for AI development. https://www.graphcanon.com/_