rtp-llm alternatives
Open-source alternatives to rtp-llm in Inference & Serving, connected by typed relationships and shared categories - ranked with live GitHub stats, not marketing.
Head-to-head comparisons
Also in the same categories
Tools that solve adjacent problems in rtp-llm's categories.
open-webui
open-webui/open-webui
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
vllm
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
unsloth
unslothai/unsloth
Unsloth Studio is a web UI for training and running open models locally.
anything-llm
Mintplex-Labs/anything-llm
Stop renting your intelligence. Own it with AnythingLLM.
mem0
mem0ai/mem0
Universal memory layer for AI Agents
litellm
BerriAI/litellm
Python SDK and Proxy Server for calling multiple LLM APIs
ray
ray-project/ray
Unified framework for scaling AI and Python applications
khoj
khoj-ai/khoj
Your AI second brain
sglang
sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
llmfit
AlexsJones/llmfit
Terminal tool for right-sizing LLM models to system hardware
Scrapegraph-ai
ScrapeGraphAI/Scrapegraph-ai
Python scraper based on AI
free-llm-api-resources
cheahjs/free-llm-api-resources
List of free LLM inference resources accessible via API.
awesome-n8n-templates
enescingoz/awesome-n8n-templates
The largest open-source collection of n8n automation templates on GitHub.
airllm
lyogavin/airllm
AirLLM enables efficient inference for large language models on low-memory GPUs without quantization.
serve
jina-ai/serve
Build multimodal AI applications with cloud-native stack
NemoClaw
NVIDIA/NemoClaw
Run agents like Hermes and OpenClaw more securely inside NVIDIA OpenShell with managed inference
ml-engineering
stas00/ml-engineering
Machine Learning Engineering Open Book
self-hosted-ai-starter-kit
n8n-io/self-hosted-ai-starter-kit
Self-hosted AI Starter Kit
