rtp-llm vs anything-llm
A neutral, constraint-first comparison - live GitHub stats and typed relationships, not marketing.
| rtp-llm | anything-llm | |
|---|---|---|
| Tagline | RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications. | Stop renting your intelligence. Own it with AnythingLLM. |
| Stars | 1.3k | 63k |
| Forks | 227 | 6.9k |
| Open issues | 163 | 328 |
| Language | Cuda | JavaScript |
| License | Apache-2.0 | MIT |
| Last pushed | Jul 7, 2026 | Jul 7, 2026 |
| Categories | Inference & Serving, LLM Frameworks | Inference & Serving, AI Agents, Developer Tools |
rtp-llm
A high-performance Large Language Model (LLM) inference acceleration engine developed by Alibaba, widely used across various business units. Supports advanced GPU optimization techniques and flexible deployment options.
Cuda
anything-llm
AnythingLLM is a JavaScript-based repository providing an all-in-one AI application for local-first agent experiences, including multimodal functionalities and self-hosted solutions.
JavaScript