--- title: "LlamaFactory" type: "tool" slug: "hiyouga-llamafactory" canonical_url: "https://www.graphcanon.com/tools/hiyouga-llamafactory" github_url: "https://github.com/hiyouga/LlamaFactory" homepage_url: "https://llamafactory.readthedocs.io" stars: 73040 forks: 8927 primary_language: "Python" license: "Apache-2.0" categories: ["llm-frameworks", "developer-tools"] tags: ["llama", "fine-tuning", "ai", "instruction-tuning", "nlp", "large-language-models", "peft", "agent"] updated_at: "2026-07-07T19:00:02.890399+00:00" --- # LlamaFactory > Unified Efficient Fine-Tuning of 100+ LLMs & VLMs A repository for fine-tuning over a hundred large language models and visual language models with ease, featuring zero-code CLI and Web UI. Used by leading tech firms like Amazon, NVIDIA, and Alibaba Cloud. ## Facts - Repository: https://github.com/hiyouga/LlamaFactory - Homepage: https://llamafactory.readthedocs.io - Stars: 73,040 · Forks: 8,927 · Open issues: 1,063 · Watchers: 339 - Primary language: Python - License: Apache-2.0 - Last pushed: 2026-07-07T09:30:58+00:00 ## Categories - [LLM Frameworks](/categories/llm-frameworks.md) - [Developer Tools](/categories/developer-tools.md) ## Tags llama, fine-tuning, ai, instruction-tuning, nlp, large-language-models, peft, agent ## Related tools - [ECC](/tools/affaan-m-ecc.md) - The agent harness performance optimization system (★ 226,962) - [AutoGPT](/tools/significant-gravitas-autogpt.md) - AutoGPT: Build, Deploy, and Run AI Agents (★ 185,417) - [ollama](/tools/ollama-ollama.md) - Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. (★ 175,659) - [prompts.chat](/tools/f-prompts-chat.md) - The world's largest open-source prompt library for AI (★ 165,019) - [transformers](/tools/huggingface-transformers.md) - 🤗 Transformers: the model-definition framework for state-of-the-art machine learning models (★ 162,347) - [JavaGuide](/tools/snailclimb-javaguide.md) - Snailclimb/JavaGuide: 面试 & 后端通用面试指南，覆盖计算机基础、数据库、分布式、高并发、系统设计与 AI 应用开发 (★ 156,863) - [open-webui](/tools/open-webui-open-webui.md) - User-friendly AI Interface (Supports Ollama, OpenAI API, ...) (★ 144,575) - [awesome-llm-apps](/tools/shubhamsaboo-awesome-llm-apps.md) - 100+ AI Agent & RAG apps you can actually run — clone, customize, ship. (★ 116,702) ## README (excerpt) ```text ### Used by [Amazon](https://aws.amazon.com/cn/blogs/machine-learning/how-apoidea-group-enhances-visual-information-extraction-from-banking-documents-with-multimodal-models-using-llama-factory-on-amazon-sagemaker-hyperpod/), [NVIDIA](https://developer.nvidia.com/rtx/ai-toolkit), [Aliyun](https://help.aliyun.com/zh/pai/use-cases/fine-tune-a-llama-3-model-with-llama-factory), etc.
### Supporters ❤️ |
Warp sponsorship
Warp, the agentic terminal for developers
Available for MacOS, Linux, & Windows | SerpAPI sponsorship | | ---- | ---- | ---- ### Easily fine-tune 100+ large language models with zero-code [CLI](#quickstart) and [Web UI](#fine-tuning-with-llama-board-gui-powered-by-gradio)
👋 Join our [WeChat](https://github.com/hiyouga/llamafactory-community/blob/main/wechat/main.jpg) and [NPU](https://github.com/hiyouga/llamafactory-community/blob/main/wechat/npu.jpg) user groups. \[ English | [中文](README_zh.md) \] **Fine-tuning a large language model can be easy as...** https://github.com/user-attachments/assets/3991a3a8-4276-4d30-9cab-4cb0c4b9b99e Start local training: - Please refer to [usage](#getting-started) Start cloud training: - **Colab (free)**: https://colab.research.google.com/drive/1eRTPn37ltBbYsISy9Aw2NuI2Aq5CQrD9?usp=sharing - **PAI-DSW (free trial)**: https://gallery.pai-ml.com/#/preview/deepLearning/nlp/llama_factory Read technical notes: - **Documentation (WIP)**: https://llamafactory.readthedocs.io/en/latest/ - **Documentation (AMD GPU)**: https://rocm.docs.amd.com/projects/ai-developer-hub/en/latest/notebooks/fine_tune/llama_factory_llama3.html - **Documentation (ASCEND NPU)**: https://llamafactory.readthedocs.io/en/latest/multibackend/npu/index.html - **Official Blog**: https://blog.llamafactory.net/en/ > [!NOTE] > Except for the above links, all other websites are unauthorized third-party websites. Please carefully use them. ## Table of Contents - [Features](#features) - [Blogs](#blogs) - [Changelog](#changelog) - [Supported Models](#supported-models) - [Supported Training Approaches](#supported-training-approaches) - [Provided Datasets](#provided-datasets) - [Requirement](#requirement) - [Getting Started](#getting-started) - [Installation](#installation) - [Data Preparation](#data-preparation) - [Quickstart](#quickstart) - [Fine-Tuning with LLaMA Board GUI](#fine-tuning-with-llama-board-gui-powered-by-gradio) - [Build Docker](#build-docker) - [Deploy with OpenAI-style API and vLLM](#deploy-with-openai-style-api-and-vllm) - [Download from ModelScope Hub](#download-from-modelscope-hub) - [Download from Modelers Hub](#download-from-modelers-hub) - [Use W&B Logger](#use-wb-logger) - [Use SwanLab Logger](#use-swanlab-logger) - [Projects using LLaMA Factory](#projects-using-llama-factory) - [License](#license) - [Citation](#citation) - [Acknowledgement](#acknowledgement) ## Features - **Various models**: LLaMA, LLaVA, Mistral, Mixtral-MoE, Qwen3, Qwen3-VL, DeepSeek, Gemma, GLM, Phi, etc. - **Integrated methods**: (Continuous) pre-training, (multimodal) supervised fine-tuning, reward modeling, PPO, DPO, KTO, ORPO, etc. - **Scalable resources**: 16-bit full-tuning, freeze-tuning, LoRA and 2/3/4/5/6/8-bit QLoRA via AQLM/AWQ/GPTQ/LLM.int8/HQQ/EETQ. - **Advanced algorithms**: [GaLore](https://github.com/jiaweizzhao/GaLore), [BAdam](https://github.com/Ledzy/BAdam), [APOLLO](https://github.com/zhuhanqing/APOLLO), [Adam-mini](https://github.com/zyushun/Adam-mini), [Muon](https://github.com/KellerJordan/Muon), [OFT](https://github.com/huggingface/peft/tree/main/src/peft/tuners/oft), DoRA, LongLoRA, LLaM ``` --- **Machine-readable endpoints** - JSON: [`/api/graphcanon/tools/hiyouga-llamafactory`](/api/graphcanon/tools/hiyouga-llamafactory) - LLM index: [/llms.txt](/llms.txt) - Full corpus: [/llms-full.txt](/llms-full.txt) _GraphCanon - The knowledge graph for AI development. https://www.graphcanon.com/_