--- title: "LLM Frameworks" type: "category" slug: "llm-frameworks" canonical_url: "https://www.graphcanon.com/categories/llm-frameworks" tool_count: 498 --- # LLM Frameworks *GraphCanon updated Oct 12, 2026* Frameworks and orchestration libraries for building LLM applications โ€” prompting, chaining, RAG, and agent scaffolding (LangChain, LlamaIndex, Haystack). GraphCanon lists 498 published tools in LLM Frameworks. ECC leads adoption at 261,432 GitHub stars. Pick on constraints, not hype: orchestration depth, RAG needs, agent loops, and team tolerance for framework surface area. GraphCanon ranks tools by typed graph relationships and live GitHub maintenance signals - not ad spend. 498 tools in this category (showing the top 60 by stars). ## Featured comparisons - [Yi vs Qwen](/compare/01-ai-yi-vs-qwenlm-qwen.md) - [Yi vs LLMs-from-scratch](/compare/01-ai-yi-vs-rasbt-llms-from-scratch.md) - [hexstrike-ai vs PentestGPT](/compare/0x4m4-hexstrike-ai-vs-greydgl-pentestgpt.md) - [rig vs LocalAI](/compare/0xplaygrounds-rig-vs-mudler-localai.md) - [1Panel vs open-webui](/compare/1panel-dev-1panel-vs-open-webui-open-webui.md) - [MaxKB vs WeKnora](/compare/1panel-dev-maxkb-vs-tencent-weknora.md) - [ChatTTS vs LLaMA-Omni](/compare/2noise-chattts-vs-ictnlp-llama-omni.md) - [ChatTTS vs whisper](/compare/2noise-chattts-vs-openai-whisper.md) ## Stacks - [The RAG stack](/stacks/rag-pipeline.md) - [The AI agent stack](/stacks/autonomous-agent.md) ## Tools - [ECC](/tools/affaan-m-ecc.md) - Agent harness performance optimization system for AI agents and LLMs (โ˜… 261,432) [Very active] - [transformers](/tools/huggingface-transformers.md) - ๐Ÿค— Transformers: state-of-the-art machine learning models for text, vision, audio, and multimodal models (โ˜… 166,279) [Very active] - [tensorflow](/tools/tensorflow-tensorflow.md) - An Open Source Machine Learning Framework for Everyone (โ˜… 200,493) [Very active] - [generative-ai-for-beginners](/tools/microsoft-generative-ai-for-beginners.md) - 21 Lessons for Getting Started with Generative AI (โ˜… 120,108) [Very active] - [open-webui](/tools/open-webui-open-webui.md) - User-friendly AI Interface (โ˜… 152,445) [Very active] - [langchain](/tools/langchain-ai-langchain.md) - The agent engineering platform. (โ˜… 146,576) [Very active] - [ollama](/tools/ollama-ollama.md) - Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. (โ˜… 181,196) [Very active] - [LLMs-from-scratch](/tools/rasbt-llms-from-scratch.md) - Implement a ChatGPT-like LLM in PyTorch from scratch, step by step (โ˜… 105,176) [Very active] - [LlamaFactory](/tools/hiyouga-llamafactory.md) - Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (โ˜… 74,849) [Very active] - [system_prompts_leaks](/tools/asgeirtj-system-prompts-leaks.md) - Leaked system prompts from various AI agents (โ˜… 67,400) [Very active] - [unsloth](/tools/unslothai-unsloth.md) - Local UI for running and training LLMs and diffusion models (โ˜… 76,344) [Very active] - [JeecgBoot](/tools/jeecgboot-jeecgboot.md) - ไผไธš็บงAIไฝŽไปฃ็ ๅนณๅฐ๏ผŒไธ€้”ฎ็”Ÿๆˆๅ‰ๅŽ็ซฏไปฃ็ ็”š่‡ณๆ•ดไธช็ณป็ปŸ (โ˜… 47,882) [Very active] - [TradingAgents](/tools/tauricresearch-tradingagents.md) - Multi-Agents LLM Financial Trading Framework (โ˜… 107,378) [Very active] - [LocalAI](/tools/mudler-localai.md) - Open-source AI engine for running various models on any hardware (โ˜… 49,150) [Very active] - [TrendRadar](/tools/sansan0-trendradar.md) - AI-driven public opinion and trend monitor with multi-platform aggregation, RSS, and smart alerts. (โ˜… 62,357) [Very active] - [graphrag](/tools/microsoft-graphrag.md) - A modular graph-based Retrieval-Augmented Generation (RAG) system (โ˜… 36,025) [Very active] - [RAG_Techniques](/tools/nirdiamant-rag-techniques.md) - Showcases advanced Retrieval-Augmented Generation (RAG) techniques with detailed notebook tutorials. (โ˜… 29,525) [Very active] - [haystack](/tools/deepset-ai-haystack.md) - Open-source AI orchestration framework for building context-engineered, production-ready LLM applications (โ˜… 26,536) [Very active] - [repomix](/tools/yamadashy-repomix.md) - Packs repository into AI-friendly files for LLMs and AI tools (โ˜… 28,394) [Very active] - [airllm](/tools/lyogavin-airllm.md) - Inference for AirLLM 70B model with single 4GB GPU (โ˜… 34,504) [Very active] - [peft](/tools/huggingface-peft.md) - State-of-the-art Parameter-Efficient Fine-Tuning (โ˜… 21,704) [Very active] - [context7](/tools/upstash-context7.md) - Up-to-date code documentation for LLMs and AI code editors (โ˜… 62,153) [Very active] - [daily_stock_analysis](/tools/zhulinsen-daily-stock-analysis.md) - LLM-powered multi-market stock analysis system with multi-source market data, real-time news, decision dashboard, automated notifications, and cost-free scheduled runs. (โ˜… 65,232) [Very active] - [awesome-ai-apps](/tools/arindam200-awesome-ai-apps.md) - A curated list of AI applications showcasing RAG, agents, and workflows. (โ˜… 15,671) [Very active] - [FinGPT](/tools/ai4finance-foundation-fingpt.md) - Open-Source Financial Large Language Models (โ˜… 21,265) [Very active] - [unity-mcp](/tools/coplaydev-unity-mcp.md) - Bridge between AI assistants and Unity Editor for asset management, scene control, script editing, task automation (โ˜… 14,343) [Very active] - [ai-engineering-hub](/tools/patchy631-ai-engineering-hub.md) - Tutorials on LLMs, RAGs, and real-world AI agent applications (โ˜… 37,020) [Active] - [quivr](/tools/quivrhq-quivr.md) - Opiniated RAG for integrating GenAI in your apps (โ˜… 39,533) [Active] - [mcp-for-blender](/tools/ahujasid-mcp-for-blender.md) - Community plugin to control Blender 3D with any LLM of your choice (โ˜… 28,925) [Very active] - [agenticSeek](/tools/fosowl-agenticseek.md) - Autonomous agent for local AI tasks, web browsing, and coding (โ˜… 27,244) [Very active] - [ludwig](/tools/ludwig-ai-ludwig.md) - Low-code framework for building custom LLMs and AI models (โ˜… 11,772) [Very active] - [litgpt](/tools/lightning-ai-litgpt.md) - High-performance LLMs for pretraining, finetuning, and deployment (โ˜… 13,667) [Very active] - [WeKnora](/tools/tencent-weknora.md) - Open-source LLM knowledge platform for creating a queryable RAG, autonomous reasoning agent, and self-maintaining Wiki. (โ˜… 19,992) [Very active] - [happy-llm](/tools/datawhalechina-happy-llm.md) - ไปŽ้›ถๅผ€ๅง‹ๆž„ๅปบๅคงๆจกๅž‹ (โ˜… 33,889) [Steady] - [DB-GPT](/tools/eosphoros-ai-db-gpt.md) - open-source agentic AI data assistant for the next generation of AI + Data products (โ˜… 19,740) [Very active] - [awesome-gpt-image-2](/tools/freestylefly-awesome-gpt-image-2.md) - Prompt-as-Code industrial-level prompt engine and template library for AI image generation (โ˜… 32,867) [Active] - [graphiti](/tools/getzep-graphiti.md) - Build Real-Time Knowledge Graphs for AI Agents (โ˜… 30,018) [Very active] - [ai-guide](/tools/liyupi-ai-guide.md) - ๅ…่ดนๅผ€ๆ”พ็š„AI็Ÿฅ่ฏ†ๅ…ฑไบซๅนณๅฐ (โ˜… 18,766) [Active] - [semantic-kernel](/tools/microsoft-semantic-kernel.md) - Integrate cutting-edge LLM technology quickly and easily into your apps (โ˜… 28,575) [Very active] - [ml-engineering](/tools/stas00-ml-engineering.md) - Machine Learning Engineering Open Book (โ˜… 19,009) [Very active] - [all-in-rag](/tools/datawhalechina-all-in-rag.md) - ๐Ÿ” ๆฃ€็ดขๅขžๅผบ็”Ÿๆˆ (RAG) ๆŠ€ๆœฏๅ…จๆ ˆๆŒ‡ๅ— (โ˜… 10,437) [Active] - [prompt-optimizer](/tools/linshenkx-prompt-optimizer.md) - An AI prompt optimizer for writing better prompts and getting better AI results. (โ˜… 34,977) [Active] - [langchain4j](/tools/langchain4j-langchain4j.md) - Java library for building LLM-powered applications on the JVM (โ˜… 13,039) [Very active] - [Awesome-Multimodal-Large-Language-Models](/tools/bradyfu-awesome-multimodal-large-language-models.md) - Latest Advances on Multimodal Large Language Models (โ˜… 18,026) [Very active] - [chainlit](/tools/chainlit-chainlit.md) - Build Conversational AI in minutes โšก๏ธ (โ˜… 12,435) [Active] - [bisheng](/tools/dataelement-bisheng.md) - BISHENG is an open LLM devops platform for next generation Enterprise AI applications (โ˜… 11,879) [Very active] - [llamafile](/tools/mozilla-ai-llamafile.md) - Distribute and run LLMs with a single file. (โ˜… 25,999) [Very active] - [astrid](/tools/unicity-astrid-astrid.md) - Secure operating system for AI agents (โ˜… 10,278) [Very active] - [PocketFlow](/tools/the-pocket-pocketflow.md) - 100-line minimalist LLM framework (โ˜… 11,178) [Steady] - [llm-action](/tools/liguodongiot-llm-action.md) - Aims to share large model technology principles and practical experience (large model engineering, application implementation) (โ˜… 24,898) [Active] - [Resume-Matcher](/tools/srbhr-resume-matcher.md) - The #1 AI Harness for Building Resumes, PDFs, Cover Letters & more, locally with 100+ LLMs support. (โ˜… 28,473) [Active] - [claude-plugins-official](/tools/anthropics-claude-plugins-official.md) - Official directory of high quality Claude Code Plugins by Anthropic (โ˜… 36,510) [Very active] - [outlines](/tools/dottxt-ai-outlines.md) - Structured Outputs (โ˜… 15,841) [Very active] - [axolotl](/tools/axolotl-ai-cloud-axolotl.md) - Go ahead and axolotl questions (โ˜… 12,503) [Very active] - [awesome-chatgpt-prompts-zh](/tools/plexpt-awesome-chatgpt-prompts-zh.md) - ChatGPT ไธญๆ–‡่ฐƒๆ•™ๆŒ‡ๅ— (โ˜… 63,334) [Slowing] - [FlagEmbedding](/tools/flagopen-flagembedding.md) - Retrieval and Retrieval-augmented LLMs (โ˜… 12,177) [Active] - [promptflow](/tools/microsoft-promptflow.md) - Build high-quality LLM apps from prototyping to production deployment and monitoring (โ˜… 11,245) [Active] - [heretic](/tools/p-e-w-heretic.md) - Fully automatic censorship removal for language models (โ˜… 31,738) [Active] - [awesome-generative-ai-guide](/tools/aishwaryanr-awesome-generative-ai-guide.md) - A one stop repository for generative AI research updates, interview resources, notebooks and much more! (โ˜… 29,463) [Very active] - [langextract](/tools/google-langextract.md) - Python library for extracting structured information from unstructured text using LLMs (โ˜… 38,614) [Very active] ## Common questions ### What are the best llm frameworks tools? GraphCanon ranks LLM Frameworks tools by GitHub adoption and freshness. ECC is the current leader (261,432 stars). See the full list on this page - sorted by stars, with [maintenance labels](/glossary/trust-and-signals/maintenance-label) and graph relationships. ### How does GraphCanon rank LLM Frameworks tools? We sort by GitHub stars and push recency on category pages, not paid placement. Alternatives and compare pages use [typed graph edges](/glossary/knowledge-graph/typed-edge) (alternative, successor, integrates_with) plus shared categories - constraint-first, not marketing votes. ### How many tools are in LLM Frameworks? 498 published tools are tagged with LLM Frameworks in the GraphCanon knowledge graph. ### What are popular LLM Frameworks comparisons? Head-to-head compare pages in this category include Yi vs Qwen, Yi vs LLMs-from-scratch, hexstrike-ai vs PentestGPT. Each comparison uses live GitHub stats and optional [trust signals](/glossary/trust-and-signals/trust-signal) - see the comparisons block on this page. ### Which stacks use LLM Frameworks? Curated workflow pages that include LLM Frameworks: [The RAG stack](/stacks/rag-pipeline); [The AI agent stack](/stacks/autonomous-agent). Each stack step includes when-not-to-use guidance. ### Where are graph-backed alternatives hubs for LLM Frameworks? High-intent OSS-vs-OSS alternatives pages include [LangChain alternatives](/tools/langchain-ai-langchain/alternatives), [LlamaIndex alternatives](/tools/run-llama-llama-index/alternatives), [Qdrant alternatives](/tools/qdrant-qdrant/alternatives), [FinRobot alternatives](/tools/ai4finance-foundation-finrobot/alternatives), [free-llm-api-resources alternatives](/tools/cheahjs-free-llm-api-resources/alternatives), [caveman alternatives](/tools/juliusbrussee-caveman/alternatives), [rtk alternatives](/tools/rtk-ai-rtk/alternatives), [unsloth alternatives](/tools/unslothai-unsloth/alternatives), [ollama alternatives](/tools/ollama-ollama/alternatives). Each hub ranks typed graph neighbors and constraint tags - not popularity votes. ### Is there a machine-readable LLM Frameworks list? Yes. Append `.md` to this URL or fetch [`/md/categories/llm-frameworks`](/md/categories/llm-frameworks) for a markdown twin. The JSON API exposes the same corpus at [`/api/graphcanon/categories/llm-frameworks`](/api/graphcanon/categories/llm-frameworks). --- **Machine-readable endpoints** - JSON: [`/api/graphcanon/categories/llm-frameworks`](/api/graphcanon/categories/llm-frameworks) - LLM index: [/llms.txt](/llms.txt) - Full corpus: [/llms-full.txt](/llms-full.txt) _GraphCanon - The knowledge graph for AI development. https://www.graphcanon.com/_