---
title: "airllm alternatives"
type: "alternatives"
slug: "lyogavin-airllm"
canonical_url: "https://www.graphcanon.com/tools/lyogavin-airllm/alternatives"
of: "lyogavin-airllm"
count: 24
---

# airllm alternatives

Open-source alternatives to [airllm](/tools/lyogavin-airllm.md) in Model Training, Inference & Serving.

## Direct alternatives

- [vllm](/tools/vllm-project-vllm.md) - A high-throughput and memory-efficient inference and serving engine for LLMs (★ 85,621)

## Same categories

- [transformers](/tools/huggingface-transformers.md) - 🤗 Transformers: the model-definition framework for state-of-the-art machine learning models (★ 162,350)
- [open-webui](/tools/open-webui-open-webui.md) - User-friendly AI Interface (Supports Ollama, OpenAI API, ...) (★ 144,582)
- [llama.cpp](/tools/ggml-org-llama-cpp.md) - LLM inference in C/C++ (★ 119,588)
- [LLMs-from-scratch](/tools/rasbt-llms-from-scratch.md) - Implement a ChatGPT-like LLM in PyTorch from scratch (★ 98,715)
- [rtk](/tools/rtk-ai-rtk.md) - CLI proxy reducing LLM token consumption by 60-90% (★ 69,277)
- [unsloth](/tools/unslothai-unsloth.md) - Unsloth Studio is a web UI for training and running open models locally. (★ 67,888)
- [anything-llm](/tools/mintplex-labs-anything-llm.md) - Stop renting your intelligence. Own it with AnythingLLM. (★ 62,770)
- [mem0](/tools/mem0ai-mem0.md) - Universal memory layer for AI Agents (★ 60,324)
- [litellm](/tools/berriai-litellm.md) - Python SDK and Proxy Server for calling over 100 LLM APIs in OpenAI format (★ 52,883)
- [LocalAI](/tools/mudler-localai.md) - LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required. (★ 47,388)
- [JeecgBoot](/tools/jeecgboot-jeecgboot.md) - AI 低代码平台【双重驱动模式】支持快捷开发 (★ 46,959)
- [ray](/tools/ray-project-ray.md) - Unified framework for scaling AI and Python applications (★ 43,154)
- [Langchain-Chatchat](/tools/chatchat-space-langchain-chatchat.md) - Langchain-Chatchat is a local knowledge-based RAG and Agent application for LLMs like ChatGLM, Qwen and Llama. (★ 38,265)
- [ai-engineering-from-scratch](/tools/rohitg00-ai-engineering-from-scratch.md) - Curriculum for building AI systems from scratch (★ 37,583)
- [khoj](/tools/khoj-ai-khoj.md) - Your AI second brain. Self-hostable. (★ 35,518)
- [self-llm](/tools/datawhalechina-self-llm.md) - 《开源大模型食用指南》 (★ 31,199)
- [sglang](/tools/sgl-project-sglang.md) - SGLang high-performance serving framework (★ 30,045)
- [llmfit](/tools/alexsjones-llmfit.md) - Hundreds of models & providers. One command to find what runs on your hardware. (★ 29,185)
- [chroma](/tools/chroma-core-chroma.md) - Data infrastructure for AI (★ 28,721)
- [free-llm-api-resources](/tools/cheahjs-free-llm-api-resources.md) - Repository listing free and trial-based LLM inference API resources (★ 26,175)
- [heretic](/tools/p-e-w-heretic.md) - Fully automatic censorship removal for language models (★ 25,895)
- [haystack](/tools/deepset-ai-haystack.md) - Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. (★ 25,842)
- [llm-action](/tools/liguodongiot-llm-action.md) - 分享大模型技术原理与实战经验，涵盖工程化和应用落地 (★ 24,670)

---

**Machine-readable endpoints**

- JSON: [`/api/graphcanon/graph?tool=lyogavin-airllm`](/api/graphcanon/graph?tool=lyogavin-airllm)
- LLM index: [/llms.txt](/llms.txt)
- Full corpus: [/llms-full.txt](/llms-full.txt)

_GraphCanon - The knowledge graph for AI development. https://www.graphcanon.com/_