---
title: "litellm vs PowerInfer"
type: "comparison"
canonical_url: "https://www.graphcanon.com/compare/berriai-litellm-vs-tiiny-ai-powerinfer"
tools: ["berriai-litellm", "tiiny-ai-powerinfer"]
---

# litellm vs PowerInfer

Neutral, constraint-first comparison with live GitHub stats.

| | [litellm](/tools/berriai-litellm.md) | [PowerInfer](/tools/tiiny-ai-powerinfer.md) |
| --- | --- | --- |
| Tagline | Python SDK and Proxy Server for calling over 100 LLM APIs in OpenAI format | High-speed Large Language Model Serving for Local Deployment |
| Stars | 52,883 | 9,628 |
| Forks | 9,543 | 585 |
| Open issues | 3,688 | 129 |
| Language | Python | C++ |
| License | Other | MIT |
| Categories | Inference & Serving, LLM Frameworks | Inference & Serving, LLM Frameworks |

---

**Machine-readable endpoints**

- JSON: [`/api/graphcanon/graph?tool=berriai-litellm`](/api/graphcanon/graph?tool=berriai-litellm)
- LLM index: [/llms.txt](/llms.txt)
- Full corpus: [/llms-full.txt](/llms-full.txt)

_GraphCanon - The knowledge graph for AI development. https://www.graphcanon.com/_