vllm-ascend alternatives
Open-source alternatives to vllm-ascend in Inference & Serving, connected by typed relationships and shared categories - ranked with live GitHub stats, not marketing.
Head-to-head comparisons
Also in the same categories
Tools that solve adjacent problems in vllm-ascend's categories.
open-webui
open-webui/open-webui
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
vllm
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
unsloth
unslothai/unsloth
Unsloth Studio is a web UI for training and running open models locally.
anything-llm
Mintplex-Labs/anything-llm
Stop renting your intelligence. Own it with AnythingLLM.
mem0
mem0ai/mem0
Universal memory layer for AI Agents
litellm
BerriAI/litellm
Python SDK and Proxy Server for calling over 100 LLM APIs in OpenAI format
JeecgBoot
jeecgboot/JeecgBoot
AI 低代码平台【双重驱动模式】支持快捷开发
ray
ray-project/ray
Unified framework for scaling AI and Python applications
ai-engineering-from-scratch
rohitg00/ai-engineering-from-scratch
Curriculum for building AI systems from scratch
khoj
khoj-ai/khoj
Your AI second brain. Self-hostable.
self-llm
datawhalechina/self-llm
《开源大模型食用指南》
llmfit
AlexsJones/llmfit
Hundreds of models & providers. One command to find what runs on your hardware.
chroma
chroma-core/chroma
Data infrastructure for AI
free-llm-api-resources
cheahjs/free-llm-api-resources
Repository listing free and trial-based LLM inference API resources
haystack
deepset-ai/haystack
Open-source AI orchestration framework for building context-engineered, production-ready LLM applications.
awesome-n8n-templates
enescingoz/awesome-n8n-templates
A large collection of free n8n automation templates
airllm
lyogavin/airllm
Repository for running large language models with reduced memory usage on limited GPU hardware.
