LocalAI alternatives
Open-source alternatives to LocalAI in Inference & Serving, LLM Frameworks, AI Agents, connected by typed relationships and shared categories - ranked with live GitHub stats, not marketing.
Direct alternatives
Explicit alternative or successor relationships in the graph.
ollama
ollama/ollama
Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
vllm
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
jan
janhq/jan
Open-source ChatGPT replacement
llmfit
AlexsJones/llmfit
Hundreds of models & providers. One command to find what runs on your hardware.
rig
0xPlaygrounds/rig
Build modular and scalable LLM Applications in Rust
Head-to-head comparisons
Also in the same categories
Tools that solve adjacent problems in LocalAI's categories.
AutoGPT
Significant-Gravitas/AutoGPT
AutoGPT: Build, Deploy, and Run AI Agents
prompts.chat
f/prompts.chat
The world's largest open-source prompt library for AI
dify
langgenius/dify
Production-ready platform for agentic workflow development
open-webui
open-webui/open-webui
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
awesome-llm-apps
Shubhamsaboo/awesome-llm-apps
100+ AI Agent & RAG apps you can actually run — clone, customize, ship.
gemini-cli
google-gemini/gemini-cli
Gemini CLI - An AI agent for your terminal
LLMs-from-scratch
rasbt/LLMs-from-scratch
Implement a ChatGPT-like LLM in PyTorch from scratch
TradingAgents
TauricResearch/TradingAgents
TradingAgents: Multi-Agents LLM Financial Trading Framework
claude-mem
thedotmack/claude-mem
Persistent Context Across Sessions for Every Agent
caveman
JuliusBrussee/caveman
Cuts 65% of tokens in AI coding agent responses.
