--- title: "llm-engineer-toolkit" type: "tool" slug: "kalyanks-nlp-llm-engineer-toolkit" canonical_url: "https://www.graphcanon.com/tools/kalyanks-nlp-llm-engineer-toolkit" github_url: "https://github.com/KalyanKS-NLP/llm-engineer-toolkit" homepage_url: "https://www.linkedin.com/in/kalyanksnlp/" stars: 10570 forks: 1669 primary_language: null license: "Apache-2.0" categories: ["llm-frameworks", "developer-tools"] tags: ["llms", "ai-engineer", "large-language-models", "generative-ai", "llm-engineer"] updated_at: "2026-07-07T18:33:23.469156+00:00" --- # llm-engineer-toolkit > LLM Engineer Toolkit A curated list of over 120 LLM libraries categorized for ease of use. ## Facts - Repository: https://github.com/KalyanKS-NLP/llm-engineer-toolkit - Homepage: https://www.linkedin.com/in/kalyanksnlp/ - Stars: 10,570 · Forks: 1,669 · Open issues: 19 · Watchers: 174 - License: Apache-2.0 - Last pushed: 2026-06-25T07:17:15+00:00 ## Categories - [LLM Frameworks](/categories/llm-frameworks.md) - [Developer Tools](/categories/developer-tools.md) ## Tags llms, ai-engineer, large-language-models, generative-ai, llm-engineer ## Related tools - [ECC](/tools/affaan-m-ecc.md) - The agent harness performance optimization system (★ 226,962) - [AutoGPT](/tools/significant-gravitas-autogpt.md) - AutoGPT: Build, Deploy, and Run AI Agents (★ 185,417) - [ollama](/tools/ollama-ollama.md) - Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. (★ 175,659) - [prompts.chat](/tools/f-prompts-chat.md) - The world's largest open-source prompt library for AI (★ 165,019) - [transformers](/tools/huggingface-transformers.md) - 🤗 Transformers: the model-definition framework for state-of-the-art machine learning models (★ 162,347) - [JavaGuide](/tools/snailclimb-javaguide.md) - Snailclimb/JavaGuide: 面试 & 后端通用面试指南，覆盖计算机基础、数据库、分布式、高并发、系统设计与 AI 应用开发 (★ 156,863) - [open-webui](/tools/open-webui-open-webui.md) - User-friendly AI Interface (Supports Ollama, OpenAI API, ...) (★ 144,575) - [awesome-llm-apps](/tools/shubhamsaboo-awesome-llm-apps.md) - 100+ AI Agent & RAG apps you can actually run — clone, customize, ship. (★ 116,702) ## README (excerpt) ```text # 👨🏻‍💻 LLM Engineer Toolkit This repository contains a curated list of 120+ LLM libraries category wise.

LinkedIn Twitter Twitter

## Related Repositories - 👨🏻‍💻[LLM Interview Questions and Answers Hub](https://github.com/KalyanKS-NLP/LLM-Interview-Questions-and-Answers-Hub) - 100+ LLM interview questions and answers (basic to advanced). - 🚀[Prompt Engineering Techniques Hub](https://github.com/KalyanKS-NLP/Prompt-Engineering-Techniques-Hub) - 25+ prompt engineering techniques with LangChain implementations. - 🩸[LLM, RAG and Agents Survey Papers Collection](https://github.com/KalyanKS-NLP/LLM-Survey-Papers-Collection) - Category wise collection of 200+ survey papers. ## Stay Updated with Generative AI, LLMs, Agents and RAG. Join 🚀 [**AIxFunda** free newsletter](https://aixfunda.substack.com/) to get *latest updates* and *interesting tutorials* related to Generative AI, LLMs, Agents and RAG. - ✨ Weekly GenAI updates - 📄 Weekly LLM, Agents and RAG paper updates - 📝 1 fresh blog post on an interesting topic every week ## Quick links |||| |---|---|---| | [🚀 LLM Training](#llm-training-and-fine-tuning) | [🧱 LLM Application Development](#llm-application-development) | [🩸LLM RAG](#llm-rag) | | [🟩 LLM Inference](#llm-inference)| [🚧 LLM Serving](#llm-serving) | [📤 LLM Data Extraction](#llm-data-extraction) | | [🌠 LLM Data Generation](#llm-data-generation) | [💎 LLM Agents](#llm-agents)|[⚖️ LLM Evaluation](#llm-evaluation) | | [🔍 LLM Monitoring](#llm-monitoring) | [📅 LLM Prompts](#llm-prompts) | [📝 LLM Structured Outputs](#llm-structured-outputs) | | [🛑 LLM Safety and Security](#llm-safety-and-security) | [💠 LLM Embedding Models](#llm-embedding-models) | [❇️ Others](#others) | ## LLM Training and Fine-Tuning | Library | Description | Link | |---------------------|-------------------------------------------------------------------------------------------------|------| | unsloth | Fine-tune LLMs faster with less memory. | [Link](https://github.com/unslothai/unsloth) | | PEFT | State-of-the-art Parameter-Efficient Fine-Tuning library. | [Link](https://github.com/huggingface/peft) | | TRL | Train transformer language models with reinforcement learning. | [Link](https://github.com/huggingface/trl) | | Transformers | Transformers provides thousands of pretrained models to perform tasks on different modalities such as text, vision, and audio. | [Link](https://github.com/huggingface/transformers) | | Axolotl | Tool designed to streamline post-training for various AI models. | [Link](https://github.com/axolotl-ai-cloud/axolotl/) | | LLMBox | A comprehensive library for implementing LLMs, including a unified training pipeline and comprehensive model evaluation. | [Link](https://github.com/RUCAIBox/LLMBox) | | LitGPT | Train and fine-tune LLM lightning fast. | [Link](https://github.com/Lightning-AI/litgpt) | | Mergoo | A library for easily merging multiple LLM experts, and efficiently train the merged LLM. | [Link](https://github.com/Leeroo-AI/mergoo) | | Llama-Factory | Easy and efficient LLM f ``` --- **Machine-readable endpoints** - JSON: [`/api/graphcanon/tools/kalyanks-nlp-llm-engineer-toolkit`](/api/graphcanon/tools/kalyanks-nlp-llm-engineer-toolkit) - LLM index: [/llms.txt](/llms.txt) - Full corpus: [/llms-full.txt](/llms-full.txt) _GraphCanon - The knowledge graph for AI development. https://www.graphcanon.com/_