---
title: "rtp-llm vs litellm"
type: "comparison"
canonical_url: "https://www.graphcanon.com/compare/alibaba-rtp-llm-vs-berriai-litellm"
tools: ["alibaba-rtp-llm", "berriai-litellm"]
---

# rtp-llm vs litellm

Neutral, constraint-first comparison with live GitHub stats.

| | [rtp-llm](/tools/alibaba-rtp-llm.md) | [litellm](/tools/berriai-litellm.md) |
| --- | --- | --- |
| Tagline | RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications. | Python SDK and Proxy Server for calling over 100 LLM APIs in OpenAI format |
| Stars | 1,258 | 52,899 |
| Forks | 227 | 9,548 |
| Open issues | 163 | 3,711 |
| Language | Cuda | Python |
| License | Apache-2.0 | Other |
| Categories | Inference & Serving, LLM Frameworks | Inference & Serving, LLM Frameworks |

---

**Machine-readable endpoints**

- JSON: [`/api/graphcanon/graph?tool=alibaba-rtp-llm`](/api/graphcanon/graph?tool=alibaba-rtp-llm)
- LLM index: [/llms.txt](/llms.txt)
- Full corpus: [/llms-full.txt](/llms-full.txt)

_GraphCanon - The knowledge graph for AI development. https://www.graphcanon.com/_