--- title: "Open-source LLM fine-tuning and model training tools" type: "category" slug: "model-training" canonical_url: "https://www.graphcanon.com/categories/model-training" tool_count: 572 description: "Compare Unsloth, LlamaFactory, TRL, and Axolotl for fine-tuning. GraphCanon ranks open-source model training tools by GitHub stars and push freshness." --- # Model Training *GraphCanon updated Oct 12, 2026* Model training tools cover fine-tuning and post-training (LoRA, QLoRA, RLHF) when prompting and RAG are not enough for style, format, or domain behavior. Prefer lighter adapters before full fine-tunes; skip training entirely if retrieval already covers missing knowledge. GraphCanon lists published open-source toolkits with live GitHub signals, featured compares, and alternatives hubs for the highest-intent pairs. transformers currently leads this list at 166,279 GitHub stars among 572 published tools. 572 tools in this category (showing the top 60 by stars). ## Featured comparisons - [Unsloth vs Axolotl](/compare/axolotl-ai-cloud-axolotl-vs-unslothai-unsloth.md) - [Unsloth vs LlamaFactory](/compare/hiyouga-llamafactory-vs-unslothai-unsloth.md) - [Ollama vs Unsloth](/compare/ollama-ollama-vs-unslothai-unsloth.md) ## Alternatives hubs - [Unsloth alternatives](/tools/unslothai-unsloth/alternatives.md) - [LlamaFactory alternatives](/tools/hiyouga-llamafactory/alternatives.md) - [TRL alternatives](/tools/huggingface-trl/alternatives.md) ## Stacks - [The local / self-hosted LLM stack](/stacks/local-llm.md) ## Tools - [transformers](/tools/huggingface-transformers.md) - πŸ€— Transformers: state-of-the-art machine learning models for text, vision, audio, and multimodal models (β˜… 166,279) [Very active] - [tensorflow](/tools/tensorflow-tensorflow.md) - An Open Source Machine Learning Framework for Everyone (β˜… 200,493) [Very active] - [LLMs-from-scratch](/tools/rasbt-llms-from-scratch.md) - Implement a ChatGPT-like LLM in PyTorch from scratch, step by step (β˜… 105,176) [Very active] - [caveman](/tools/juliusbrussee-caveman.md) - Reduces token usage by 65% through minimalistic language for coding agents (β˜… 106,401) [Very active] - [keras](/tools/keras-team-keras.md) - Deep Learning for humans (β˜… 64,343) [Very active] - [LlamaFactory](/tools/hiyouga-llamafactory.md) - Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (β˜… 74,849) [Very active] - [unsloth](/tools/unslothai-unsloth.md) - Local UI for running and training LLMs and diffusion models (β˜… 76,344) [Very active] - [headroom](/tools/headroomlabs-ai-headroom.md) - Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. (β˜… 72,850) [Very active] - [llama_index](/tools/run-llama-llama-index.md) - Document processing platform for AI (β˜… 52,207) [Very active] - [hello-agents](/tools/datawhalechina-hello-agents.md) - A comprehensive guide to building intelligent agents from scratch (β˜… 79,727) [Very active] - [LibreChat](/tools/danny-avila-librechat.md) - Enhanced ChatGPT Clone with extensive features and integrations for self-hosting (β˜… 44,416) [Very active] - [ray](/tools/ray-project-ray.md) - Unified framework for scaling AI and Python applications (β˜… 43,863) [Very active] - [LocalAI](/tools/mudler-localai.md) - Open-source AI engine for running various models on any hardware (β˜… 49,150) [Very active] - [LightRAG](/tools/hkuds-lightrag.md) - Simple and Fast Retrieval-Augmented Generation (β˜… 39,743) [Very active] - [FastGPT](/tools/labring-fastgpt.md) - A knowledge-based platform for developing and deploying complex question-answering systems (β˜… 29,690) [Very active] - [onyx](/tools/onyx-dot-app-onyx.md) - Open Source AI Platform - AI Chat with advanced features that works with every LLM (β˜… 32,153) [Very active] - [mlflow](/tools/mlflow-mlflow.md) - Open source AI engineering platform for agents, LLMs, and ML models (β˜… 28,010) [Very active] - [netron](/tools/lutzroeder-netron.md) - Visualizer for neural network, deep learning and machine learning models (β˜… 33,524) [Very active] - [RAG_Techniques](/tools/nirdiamant-rag-techniques.md) - Showcases advanced Retrieval-Augmented Generation (RAG) techniques with detailed notebook tutorials. (β˜… 29,525) [Very active] - [peft](/tools/huggingface-peft.md) - State-of-the-art Parameter-Efficient Fine-Tuning (β˜… 21,704) [Very active] - [ai-engineering-from-scratch](/tools/rohitg00-ai-engineering-from-scratch.md) - Learn, build, and deploy AI engineering skills from scratch. (β˜… 54,935) [Active] - [code-review-graph](/tools/tirth8205-code-review-graph.md) - Local-first code intelligence graph for AI coding tools (β˜… 31,569) [Very active] - [FinGPT](/tools/ai4finance-foundation-fingpt.md) - Open-Source Financial Large Language Models (β˜… 21,265) [Very active] - [generative-ai](/tools/googlecloudplatform-generative-ai.md) - Sample code and notebooks for Generative AI on Google Cloud, with Gemini Enterprise Agent Platform (β˜… 17,726) [Very active] - [ludwig](/tools/ludwig-ai-ludwig.md) - Low-code framework for building custom LLMs and AI models (β˜… 11,772) [Very active] - [txtai](/tools/neuml-txtai.md) - All-in-one AI framework for semantic search, LLM orchestration and language model workflows (β˜… 12,959) [Very active] - [pytorch](/tools/pytorch-pytorch.md) - Tensors and Dynamic neural networks in Python with strong GPU acceleration (β˜… 103,384) [Very active] - [khoj](/tools/khoj-ai-khoj.md) - Self-hostable AI second brain for personalized research and automation (β˜… 37,399) [Steady] - [unstructured](/tools/unstructured-io-unstructured.md) - Convert documents to structured data effortlessly (β˜… 15,446) [Very active] - [litgpt](/tools/lightning-ai-litgpt.md) - High-performance LLMs for pretraining, finetuning, and deployment (β˜… 13,667) [Very active] - [python-sdk](/tools/modelcontextprotocol-python-sdk.md) - Official Python SDK for Model Context Protocol servers and clients (β˜… 24,325) [Very active] - [happy-llm](/tools/datawhalechina-happy-llm.md) - δ»Žι›ΆεΌ€ε§‹ζž„ε»Ίε€§ζ¨‘εž‹ (β˜… 33,889) [Steady] - [mcp-for-beginners](/tools/microsoft-mcp-for-beginners.md) - Open-source curriculum for Model Context Protocol (MCP), covering modular and secure AI workflows in multiple languages (β˜… 17,256) [Very active] - [awesome-gpt-image-2](/tools/youmind-openlab-awesome-gpt-image-2.md) - World's largest GPT Image 2 prompt library, updated daily (β˜… 9,918) [Very active] - [ai-guide](/tools/liyupi-ai-guide.md) - ε…θ΄ΉεΌ€ζ”Ύηš„AIηŸ₯识共享平台 (β˜… 18,766) [Active] - [ml-engineering](/tools/stas00-ml-engineering.md) - Machine Learning Engineering Open Book (β˜… 19,009) [Very active] - [TensorRT-LLM](/tools/nvidia-tensorrt-llm.md) - Python API for defining and optimizing Large Language Models for efficient inference on NVIDIA GPUs (β˜… 14,645) [Very active] - [metaflow](/tools/netflix-metaflow.md) - Build, Manage and Deploy AI/ML Systems (β˜… 10,273) [Very active] - [bisheng](/tools/dataelement-bisheng.md) - BISHENG is an open LLM devops platform for next generation Enterprise AI applications (β˜… 11,879) [Very active] - [OpenRLHF](/tools/openrlhf-openrlhf.md) - Scalable and High-performance Agentic RL Framework based on Ray (β˜… 10,014) [Very active] - [DeepSpeed](/tools/deepspeedai-deepspeed.md) - Deep learning optimization library for efficient distributed training and inference (β˜… 43,065) [Very active] - [ultralytics](/tools/ultralytics-ultralytics.md) - Ultralytics YOLO27, YOLO26, YOLO11, YOLOv8 for various computer vision tasks (β˜… 61,741) [Very active] - [Paddle](/tools/paddlepaddle-paddle.md) - High-performance single-machine and distributed deep learning & machine learning framework (β˜… 24,105) [Very active] - [OpenLLM](/tools/bentoml-openllm.md) - Run any open-source LLMs as OpenAI compatible API endpoint in the cloud. (β˜… 12,527) [Very active] - [llm-action](/tools/liguodongiot-llm-action.md) - Aims to share large model technology principles and practical experience (large model engineering, application implementation) (β˜… 24,898) [Active] - [tokenizers](/tools/huggingface-tokenizers.md) - Fast State-of-the-Art Tokenizers optimized for Research and Production (β˜… 11,047) [Very active] - [llm-app](/tools/pathwaycom-llm-app.md) - Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data (β˜… 58,920) [Steady] - [axolotl](/tools/axolotl-ai-cloud-axolotl.md) - Go ahead and axolotl questions (β˜… 12,503) [Very active] - [agent-lightning](/tools/microsoft-agent-lightning.md) - The absolute trainer to light up AI agents (β˜… 17,500) [Very active] - [scikit-learn](/tools/scikit-learn-scikit-learn.md) - machine learning in Python (β˜… 67,389) [Very active] - [machine-learning-for-trading](/tools/stefan-jansen-machine-learning-for-trading.md) - Code for Machine Learning for Trading, 3rd edition, from data sourcing to live execution. (β˜… 20,925) [Very active] - [wandb](/tools/wandb-wandb.md) - Weights & Biases platform for model training and management (β˜… 11,262) [Very active] - [awesome-generative-ai-guide](/tools/aishwaryanr-awesome-generative-ai-guide.md) - A one stop repository for generative AI research updates, interview resources, notebooks and much more! (β˜… 29,463) [Very active] - [Skill_Seekers](/tools/yusufkaraaslan-skill-seekers.md) - Automation tool for converting documentation and code into Claude AI skills (β˜… 15,009) [Very active] - [CosyVoice](/tools/funaudiollm-cosyvoice.md) - Multi-lingual large voice generation model with full-stack abilities for inference, training and deployment. (β˜… 23,695) [Slowing] - [pytorch-lightning](/tools/lightning-ai-pytorch-lightning.md) - Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes. (β˜… 31,363) [Very active] - [juicefs](/tools/juicedata-juicefs.md) - Distributed POSIX file system built on Redis and S3 (β˜… 14,479) [Very active] - [LangGPT](/tools/langgptai-langgpt.md) - A pioneering framework for structured & meta-prompt design (β˜… 12,539) [Active] - [ART](/tools/openpipe-art.md) - Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. (β˜… 10,603) [Very active] - [AI-For-Beginners](/tools/microsoft-ai-for-beginners.md) - A beginner-friendly AI curriculum with multi-language support. (β˜… 68,772) [Very active] ## Common questions ### What are the best model training tools? GraphCanon ranks Model Training tools by GitHub adoption and freshness. transformers is the current leader (166,279 stars). See the full list on this page - sorted by stars, with [maintenance labels](/glossary/trust-and-signals/maintenance-label) and graph relationships. ### How does GraphCanon rank Model Training tools? We sort by GitHub stars and push recency on category pages, not paid placement. Alternatives and compare pages use [typed graph edges](/glossary/knowledge-graph/typed-edge) (alternative, successor, integrates_with) plus shared categories - constraint-first, not marketing votes. ### How many tools are in Model Training? 572 published tools are tagged with Model Training in the GraphCanon knowledge graph. ### What are popular Model Training comparisons? Head-to-head compare pages in this category include Unsloth vs Axolotl, Unsloth vs LlamaFactory, Ollama vs Unsloth. Each comparison uses live GitHub stats and optional [trust signals](/glossary/trust-and-signals/trust-signal) - see the comparisons block on this page. ### Which stacks use Model Training? Curated workflow pages that include Model Training: [The local / self-hosted LLM stack](/stacks/local-llm). Each stack step includes when-not-to-use guidance. ### Where are graph-backed alternatives hubs for Model Training? High-intent OSS-vs-OSS alternatives pages include [Unsloth alternatives](/tools/unslothai-unsloth/alternatives), [LlamaFactory alternatives](/tools/hiyouga-llamafactory/alternatives), [TRL alternatives](/tools/huggingface-trl/alternatives). Each hub ranks typed graph neighbors and constraint tags - not popularity votes. ### Is there a machine-readable Model Training list? Yes. Append `.md` to this URL or fetch [`/md/categories/model-training`](/md/categories/model-training) for a markdown twin. The JSON API exposes the same corpus at [`/api/graphcanon/categories/model-training`](/api/graphcanon/categories/model-training). --- **Machine-readable endpoints** - JSON: [`/api/graphcanon/categories/model-training`](/api/graphcanon/categories/model-training) - LLM index: [/llms.txt](/llms.txt) - Full corpus: [/llms-full.txt](/llms-full.txt) _GraphCanon - The knowledge graph for AI development. https://www.graphcanon.com/_