{"data":{"slug":"kalyanks-nlp-llm-engineer-toolkit","name":"llm-engineer-toolkit","tagline":"A curated list of over 120 LLM libraries categorized.","github_url":"https://github.com/KalyanKS-NLP/llm-engineer-toolkit","owner":"KalyanKS-NLP","repo":"llm-engineer-toolkit","owner_avatar_url":"https://avatars.githubusercontent.com/u/202506543?v=4","primary_language":null,"stars":10767,"forks":1682,"topics":["ai-engineer","generative-ai","large-language-models","llm-engineer","llms"],"archived":false,"github_pushed_at":"2026-08-16T13:05:43+00:00","maintenance_label":"Very active","stars_delta_30d":106,"url":"https://www.graphcanon.com/tools/kalyanks-nlp-llm-engineer-toolkit","markdown_url":"https://www.graphcanon.com/tools/kalyanks-nlp-llm-engineer-toolkit.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/kalyanks-nlp-llm-engineer-toolkit","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=kalyanks-nlp-llm-engineer-toolkit","description":"A curated list of  120+ LLM libraries category wise. ","homepage_url":"https://www.linkedin.com/in/kalyanksnlp/","license":"Apache-2.0","open_issues":15,"watchers":173,"ai_summary":"The repository provides a comprehensive list of large language model (LLM) libraries, categorized into different groups essential for development and application creation. It serves as a toolkit for engineers working with generative AI technologies.","readme_excerpt":"# 👨🏻‍💻 LLM Engineer Toolkit \nThis repository contains a curated list of 120+ LLM libraries category wise.\n<p align=\"center\">\n  <a href=\"https://www.linkedin.com/in/kalyanksnlp/\">\n    <img src=\"https://custom-icon-badges.demolab.com/badge/Kalyan%20KS-0A66C2?logo=linkedin-white&logoColor=fff\" alt=\"LinkedIn\">\n  </a>\n  <a href=\"https://x.com/kalyan_kpl\">\n    <img src=\"https://img.shields.io/badge/Kalyan%20KS-%23000000.svg?logo=X&logoColor=white\" alt=\"Twitter\">\n  </a>\n   <a href=\"https://www.youtube.com/@kalyanksnlp\">\n    <img src=\"https://img.shields.io/badge/Kalyan%20KS-%23FF0000.svg?logo=YouTube&logoColor=white\" alt=\"Twitter\">\n  </a>\n\t\n</p>\n\n## Related Repositories\n- 👨🏻‍💻[LLM Interview Questions and Answers Hub](https://github.com/KalyanKS-NLP/LLM-Interview-Questions-and-Answers-Hub) - 100+ LLM interview questions and answers (basic to advanced). \n- 🚀[Prompt Engineering Techniques Hub](https://github.com/KalyanKS-NLP/Prompt-Engineering-Techniques-Hub)  - 25+ prompt engineering techniques with LangChain implementations.\n- 🩸[LLM, RAG and Agents Survey Papers Collection](https://github.com/KalyanKS-NLP/LLM-Survey-Papers-Collection) - Category wise collection of 200+ survey papers.\n\n\n## 🚀 LLM Interview Questions and Answers Book \nCrack modern LLM and Generative AI interviews with this comprehensive, interview-focused guide designed specifically for ML Engineers, AI Engineers, Data Scientists and Software Engineers.\n\nThis book features **100+ carefully curated LLM interview questions**, each paired with **clear answers and in-depth explanations** so you truly understand the concepts interviewers care about. [Get the book here](https://kalyanksnlp.gumroad.com/l/llm-interview-questions-answers-book-kalyan-ks). \n\nUse the **Coupon Code: LLMQA25** for an exclusive discount (50%) on the book. (Available only for a short period of time). \n\n\n\n## Stay Updated with Generative AI, LLMs, Agents and RAG.\n\nJoin 🚀 [**AIxFunda** free newsletter](https://aixfunda.substack.com/) to get *latest updates* and *interesting tutorials* related to Generative AI, LLMs, Agents and RAG. \n- ✨ Weekly GenAI updates\n- 📄 Weekly LLM, Agents and RAG paper updates\n- 📝 1 fresh blog post on an interesting topic every week\n\n## Quick links\n||||\n|---|---|---|\n| [🚀 LLM Training](#llm-training-and-fine-tuning) | [🧱 LLM Application Development](#llm-application-development) | [🩸LLM RAG](#llm-rag) | \n| [🟩 LLM Inference](#llm-inference)| [🚧 LLM Serving](#llm-serving) | [📤 LLM Data Extraction](#llm-data-extraction) |\n| [🌠 LLM Data Generation](#llm-data-generation) | [💎 LLM Agents](#llm-agents)|[⚖️ LLM Evaluation](#llm-evaluation) | \n| [🔍 LLM Monitoring](#llm-monitoring) | [📅 LLM Prompts](#llm-prompts) | [📝 LLM Structured Outputs](#llm-structured-outputs) |\n| [🛑 LLM Safety and Security](#llm-safety-and-security) | [💠 LLM Embedding Models](#llm-embedding-models) | [❇️ Others](#others) |\n\n\n\n## LLM Training and Fine-Tuning\n| Library             | Description                                                                                     | Link |\n|---------------------|-------------------------------------------------------------------------------------------------|------|\n| unsloth            | Fine-tune LLMs faster with less memory.                                                          | [Link](https://github.com/unslothai/unsloth) |\n| PEFT                | State-of-the-art Parameter-Efficient Fine-Tuning library.                                       | [Link](https://github.com/huggingface/peft) |\n| TRL                 | Train transformer language models with reinforcement learning.                                  | [Link](https://github.com/huggingface/trl) |\n| Transformers       | Transformers provides thousands of pretrained models to perform tasks on different modalities such as text, vision, and audio. | [Link](https://github.com/huggingface/transformers) |\n| Axolotl           | Tool designed to streamline post-training for various AI models.","github_created_at":"2025-03-09T11:07:31+00:00","created_at":"2026-07-07T17:33:59.35835+00:00","updated_at":"2026-08-17T06:01:58.336674+00:00","categories":[{"slug":"developer-tools","name":"Developer Tools","url":"https://www.graphcanon.com/categories/developer-tools","markdown_url":"https://www.graphcanon.com/categories/developer-tools.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/developer-tools"},{"slug":"evaluation-observability","name":"Evaluation & Observability","url":"https://www.graphcanon.com/categories/evaluation-observability","markdown_url":"https://www.graphcanon.com/categories/evaluation-observability.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/evaluation-observability"},{"slug":"inference-serving","name":"Inference & Serving","url":"https://www.graphcanon.com/categories/inference-serving","markdown_url":"https://www.graphcanon.com/categories/inference-serving.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/inference-serving"},{"slug":"model-training","name":"Model Training","url":"https://www.graphcanon.com/categories/model-training","markdown_url":"https://www.graphcanon.com/categories/model-training.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/model-training"}],"tags":[{"slug":"ai-engineer","name":"ai-engineer"},{"slug":"generative-ai","name":"generative-ai"},{"slug":"large-language-models","name":"large language models"},{"slug":"llm-engineer","name":"llm-engineer"},{"slug":"llms","name":"llms"}],"trust":{"provenance":{"is_fork":false,"github_id":945411078,"owner_type":"User","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-08-17T06:01:57.635Z","maintenance":{"label":"Very active","score":96,"methodology":"github_public_v1","releases_90d":0,"days_since_push":0,"last_release_at":null,"stars_delta_30d":106,"open_issues_delta_30d":-5},"security_summary":{"status":"no_lockfile","scanner":null,"low_count":0,"high_count":0,"last_scan_at":"2026-07-11T11:02:22.983Z","medium_count":0,"scan_profile":"none","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-08-17T06:01:58.057Z"},"license_spdx":{"value":"Apache-2.0","source":"github.license","observed_at":"2026-08-17T06:01:58.057Z"}},"decision_facts":{"hosting":null,"pricing":null,"requirements":{"notes":["- No specific programming language requirement noted in the repository content.","- Access to various LLM libraries listed within the repository."]},"constraints":null,"when_to_use":["- You need a wide range of categorized LLM libraries to explore various aspects of LLM engineering, including training, inference, application development, evaluation, and observability.","- You are looking for a hub that provides easy navigation through different types of tools required for building scalable AI applications.","- The repository includes related repositories such as LLM Interview Questions and Answers Hub for enhanced learning."],"when_not_to_use":["- If you require real-time updates or active community support, this curated list might not provide real-time interactions compared to a more dynamic platform with an active developer community.","- You prefer specific use-case tutorials rather than a comprehensive, categorized library guide; other platforms may offer more detailed implementation guides and step-by-step instructions."],"source":"enrich:decision_facts","observed_at":"2026-07-11T15:45:19.173Z"},"constraint_facets":null,"decision_summary":[{"label":"Requirements","value":"- No specific programming language requirement noted in the repository content.; - Access to various LLM libraries listed within the repository."},{"label":"Adopt for","value":"A curated list of over 120 Large Language Model (LLM) libraries organized into categories essential for development and application creation, aimed at engineers working with generative AI technologies."},{"label":"License detail","value":"Apache-2.0 License allows for free usage, modification, and distribution but requires appropriate attribution."}]}}