Alternatives hub · graph-backed

text-generation-inference alternatives

Not a popularity vote. Each is a typed edge from text-generation-inference with the reason it exists in Inference & Serving, Developer Tools - ranked with live GitHub stats, not marketing.

vllmsuccessor

A high-throughput and memory-efficient inference and serving engine for LLMs

Python
86k
stars
ECCrelated

The agent harness performance optimization system

JavaScriptdeveloper-tools
227k
stars
AutoGPTrelated

AutoGPT: Build, Deploy, and Run AI Agents

Pythondeveloper-tools
185k
stars
prompts.chatrelated

The world's largest open-source prompt library for AI

HTMLdeveloper-tools
165k
stars
JavaGuiderelated

Snailclimb/JavaGuide: 面试 & 后端通用面试指南,覆盖计算机基础、数据库、分布式、高并发、系统设计与 AI 应用开发

JavaScriptdeveloper-tools
157k
stars
open-webuirelated

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

Pythoninference-serving
145k
stars
llama.cpprelated

LLM inference in C/C++

C++inference-serving
120k
stars
browser-userelated

🌐 Make websites accessible for AI agents. Automate tasks online with ease.

Pythondeveloper-tools
103k
stars
cavemanrelated

Cuts 65% of tokens in AI coding agent responses.

JavaScriptdeveloper-tools
86k
stars
llm-courserelated

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

developer-tools
81k
stars
OpenHandsrelated

The self-hosted developer control center for coding agents and automations.

Pythondeveloper-tools
80k
stars
graphifyrelated

AI coding assistant skill that transforms various file types into a queryable knowledge graph

Pythondeveloper-tools
79k
stars
Prompt-Engineering-Guiderelated

Repository for prompt engineering resources, guides, and tools focused on language models (LLMs).

MDXdeveloper-tools
76k
stars
open-designrelated

The open-source Claude Design alternative

TypeScriptdeveloper-tools
76k
stars
Front-End-Checklistrelated

The essential checklist for modern web development, for humans and AI agents

MDXdeveloper-tools
73k
stars
LlamaFactoryrelated

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs

Pythondeveloper-tools
73k
stars
daytonarelated

Secure and Elastic Infrastructure for Running AI-Generated Code

developer-tools
72k
stars
gpt_academicrelated

GPT 学术优化 (GPT Academic)

Pythondeveloper-tools
71k
stars
rtkrelated

CLI proxy reducing LLM token consumption by 60-90%

Rustdeveloper-toolsinference-serving
69k
stars
unslothrelated

Unsloth Studio is a web UI for training and running open models locally.

Pythondeveloper-toolsinference-serving
68k
stars
awesome-claude-skillsrelated

A curated list of Claude Skills and tools for customizing workflows.

Pythondeveloper-tools
67k
stars
anything-llmrelated

Stop renting your intelligence. Own it with AnythingLLM.

JavaScriptdeveloper-toolsinference-serving
63k
stars
worldmonitorrelated

Real-time global intelligence dashboard.

TypeScriptdeveloper-tools
62k
stars
TrendRadarrelated

AI-driven public opinion & trend monitor

Pythondeveloper-tools
60k
stars

Head-to-head comparisons

Command menu

Search tools or jump to a page