Comparison
rtp-llm vs rtk
A neutral, constraint-first comparison - live GitHub stats and typed relationships, not marketing.
| rtp-llm | rtk | |
|---|---|---|
| Tagline | RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications. | CLI proxy reducing LLM token consumption by 60-90% |
| Stars | 1.3k | 69k |
| Forks | 227 | 4.3k |
| Open issues | 163 | 1.5k |
| Language | Cuda | Rust |
| License | Apache-2.0 | Apache-2.0 |
| Last pushed | Jul 7, 2026 | Jul 7, 2026 |
| Categories | Inference & Serving, LLM Frameworks | Inference & Serving, Developer Tools |
Choose rtp-llm if…
- More recently updated (last pushed Jul 7, 2026).
- Leaner open-issue backlog (163).
- Also covers LLM Frameworks.