The local / self-hosted LLM stack
Running open models yourself for privacy, cost, or control. The stack is a serving runtime, optional fine-tuning, and supporting tooling.
Inference runtime - serve open-weight models efficiently on your hardware.
When not to use: Self-hosting rarely beats a hosted API on cost until you have steady, high-volume traffic.
AutoGPT
Significant-Gravitas/AutoGPT
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on w
transformers
huggingface/transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models,
TradingAgents
TauricResearch/TradingAgents
TradingAgents: Multi-Agents LLM Financial Trading Framework
lobehub
lobehub/lobehub
🤯 LobeHub is your Chief Agent Operator, organizing your agents into 7×24 operations by hiring, scheduling, and reporting on your entire AI
Fine-tuning - adapt an open model to your domain with LoRA or full fine-tunes.
When not to use: Try prompting and RAG first; fine-tuning is the answer to style/format, not missing knowledge.
transformers
huggingface/transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models,
LLMs-from-scratch
rasbt/LLMs-from-scratch
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
vllm
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
llm-course
mlabonne/llm-course
Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
Tooling & gateways - a unified API in front of your local models.
When not to use: Direct calls are fine for a single local model with one consumer.
JavaGuide
Snailclimb/JavaGuide
Java 面试 & 后端通用面试指南，覆盖计算机基础、数据库、分布式、高并发、系统设计与 AI 应用开发
dify
langgenius/dify
Production-ready platform for agentic workflow development.
firecrawl
firecrawl/firecrawl
The API to search, scrape, and interact with the web at scale. 🔥
browser-use
browser-use/browser-use
🌐 Make websites accessible for AI agents. Automate tasks online with ease.