---
title: "PowerInfer vs vllm"
type: "comparison"
canonical_url: "https://www.graphcanon.com/compare/tiiny-ai-powerinfer-vs-vllm-project-vllm"
tools: ["tiiny-ai-powerinfer", "vllm-project-vllm"]
---

# PowerInfer vs vllm

Neutral, constraint-first comparison with live GitHub stats.

| | [PowerInfer](/tools/tiiny-ai-powerinfer.md) | [vllm](/tools/vllm-project-vllm.md) |
| --- | --- | --- |
| Tagline | High-speed Large Language Model Serving for Local Deployment | A high-throughput and memory-efficient inference and serving engine for LLMs |
| Stars | 9,628 | 85,621 |
| Forks | 585 | 19,078 |
| Open issues | 129 | 5,598 |
| Language | C++ | Python |
| License | MIT | Apache-2.0 |
| Categories | Inference & Serving, LLM Frameworks | Model Training, Inference & Serving |

---

**Machine-readable endpoints**

- JSON: [`/api/graphcanon/graph?tool=tiiny-ai-powerinfer`](/api/graphcanon/graph?tool=tiiny-ai-powerinfer)
- LLM index: [/llms.txt](/llms.txt)
- Full corpus: [/llms-full.txt](/llms-full.txt)

_GraphCanon - The knowledge graph for AI development. https://www.graphcanon.com/_