{"data":{"slug":"kalyanks-nlp-llm-engineer-toolkit","name":"llm-engineer-toolkit","tagline":"A curated list of 120+ LLM libraries category wise","github_url":"https://github.com/KalyanKS-NLP/llm-engineer-toolkit","owner":"KalyanKS-NLP","repo":"llm-engineer-toolkit","owner_avatar_url":"https://avatars.githubusercontent.com/u/202506543?v=4","primary_language":null,"stars":10793,"forks":1687,"topics":["ai-engineer","generative-ai","large-language-models","llm-engineer","llms"],"archived":false,"github_pushed_at":"2026-09-09T01:45:07+00:00","maintenance_label":"Active","stars_delta_30d":26,"url":"https://www.graphcanon.com/tools/kalyanks-nlp-llm-engineer-toolkit","markdown_url":"https://www.graphcanon.com/tools/kalyanks-nlp-llm-engineer-toolkit.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/kalyanks-nlp-llm-engineer-toolkit","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=kalyanks-nlp-llm-engineer-toolkit","description":"A curated list of 120+ LLM libraries category wise. ","homepage_url":"https://www.linkedin.com/in/kalyanksnlp/","license":"Apache-2.0","open_issues":17,"watchers":174,"ai_summary":"This repository provides a categorized list of over 120 LLM libraries, serving as a toolkit for LLM engineers and developers.","readme_excerpt":"# 👨🏻‍💻 LLM Engineer Toolkit \nThis repository contains a curated list of 120+ LLM libraries category wise.\n

\n \n \"LinkedIn\"\n \n \n \"Twitter\"\n \n \n \"Twitter\"\n \n\t\n

\n\n## Related Repositories\n- 👨🏻‍💻[LLM Interview Questions and Answers Hub](https://github.com/KalyanKS-NLP/LLM-Interview-Questions-and-Answers-Hub) - 100+ LLM interview questions and answers (basic to advanced). \n- 🚀[Prompt Engineering Techniques Hub](https://github.com/KalyanKS-NLP/Prompt-Engineering-Techniques-Hub) - 25+ prompt engineering techniques with LangChain implementations.\n- 🩸[LLM, RAG and Agents Survey Papers Collection](https://github.com/KalyanKS-NLP/LLM-Survey-Papers-Collection) - Category wise collection of 200+ survey papers.\n\n\n## 🚀 LLM Interview Questions and Answers Book \nCrack modern LLM and Generative AI interviews with this comprehensive, interview-focused guide designed specifically for ML Engineers, AI Engineers, Data Scientists and Software Engineers.\n\nThis book features **100+ carefully curated LLM interview questions**, each paired with **clear answers and in-depth explanations** so you truly understand the concepts interviewers care about. [Get the book here](https://kalyanksnlp.gumroad.com/l/llm-interview-questions-answers-book-kalyan-ks). \n\nUse the **Coupon Code: LLMQA25** for an exclusive discount (50%) on the book. (Available only for a short period of time). \n\n\n\n## Stay Updated with Generative AI, LLMs, Agents and RAG.\n\nJoin 🚀 [**AIxFunda** free newsletter](https://aixfunda.substack.com/) to get *latest updates* and *interesting tutorials* related to Generative AI, LLMs, Agents and RAG. \n- ✨ Weekly GenAI updates\n- 📄 Weekly LLM, Agents and RAG paper updates\n- 📝 1 fresh blog post on an interesting topic every week\n\n## Quick links\n||||\n|---|---|---|\n| [🚀 LLM Training](#llm-training-and-fine-tuning) | [🧱 LLM Application Development](#llm-application-development) | [🩸LLM RAG](#llm-rag) | \n| [🟩 LLM Inference](#llm-inference)| [🚧 LLM Serving](#llm-serving) | [📤 LLM Data Extraction](#llm-data-extraction) |\n| [🌠 LLM Data Generation](#llm-data-generation) | [💎 LLM Agents](#llm-agents)|[⚖️ LLM Evaluation](#llm-evaluation) | \n| [🔍 LLM Monitoring](#llm-monitoring) | [📅 LLM Prompts](#llm-prompts) | [📝 LLM Structured Outputs](#llm-structured-outputs) |\n| [🛑 LLM Safety and Security](#llm-safety-and-security) | [💠 LLM Embedding Models](#llm-embedding-models) | [❇️ Others](#others) |\n\n\n\n## LLM Training and Fine-Tuning\n| Library | Description | Link |\n|---------------------|-------------------------------------------------------------------------------------------------|------|\n| unsloth | Fine-tune LLMs faster with less memory. | [Link](https://github.com/unslothai/unsloth) |\n| PEFT | State-of-the-art Parameter-Efficient Fine-Tuning library. | [Link](https://github.com/huggingface/peft) |\n| TRL | Train transformer language models with reinforcement learning. | [Link](https://github.com/huggingface/trl) |\n| Transformers | Transformers provides thousands of pretrained models to perform tasks on different modalities such as text, vision, and audio. | [Link](https://github.com/huggingface/transformers) |\n| Axolotl | Tool designed to streamline post-training for various AI models.","github_created_at":"2025-03-09T11:07:31+00:00","created_at":"2026-07-07T17:33:59.35835+00:00","updated_at":"2026-09-20T04:33:41.079393+00:00","categories":[{"slug":"inference-serving","name":"Inference & Serving","url":"https://www.graphcanon.com/categories/inference-serving","markdown_url":"https://www.graphcanon.com/categories/inference-serving.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/inference-serving"},{"slug":"llm-frameworks","name":"LLM Frameworks","url":"https://www.graphcanon.com/categories/llm-frameworks","markdown_url":"https://www.graphcanon.com/categories/llm-frameworks.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/llm-frameworks"},{"slug":"model-training","name":"Model Training","url":"https://www.graphcanon.com/categories/model-training","markdown_url":"https://www.graphcanon.com/categories/model-training.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/model-training"}],"tags":[{"slug":"ai-engineer","name":"ai-engineer"},{"slug":"generative-ai","name":"generative-ai"},{"slug":"large-language-models","name":"large-language-models"},{"slug":"llm-engineer","name":"llm-engineer"},{"slug":"llms","name":"llms"}],"trust":{"provenance":{"is_fork":false,"github_id":945411078,"owner_type":"User","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-09-18T08:49:41.855Z","maintenance":{"label":"Active","score":82,"methodology":"github_public_v1","releases_90d":0,"days_since_push":9,"last_release_at":null,"stars_delta_30d":26,"open_issues_delta_30d":2},"security_summary":{"status":"no_lockfile","scanner":null,"low_count":0,"high_count":0,"last_scan_at":"2026-09-18T08:49:44.034Z","medium_count":0,"scan_profile":"none","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-09-18T08:49:40.800Z"},"license_spdx":{"value":"Apache-2.0","source":"github.license","observed_at":"2026-09-18T08:49:40.800Z"}},"decision_facts":{"hosting":null,"pricing":null,"requirements":null,"constraints":null,"when_to_use":["When you need a categorized list of over 120 LLM libraries to streamline your search for specific tools or frameworks.","If you are an LLM engineer or developer looking for a comprehensive resource to support your work in model training, inference, and serving."],"when_not_to_use":["If you are seeking a repository that provides detailed implementation guides or code samples for each library, as the llm-engineer-toolkit primarily serves as a list.","When you require real-time updates or active development support, as the toolkit is a static list and does not include active development or community support features."],"source":"enrich:decision_facts","observed_at":"2026-09-18T10:37:33.073Z"},"constraint_facets":null,"decision_summary":[{"label":"Adopt for","value":"The llm-engineer-toolkit is a curated list of over 120 LLM libraries, organized into categories such as LLM Training, Inference, and Serving, aimed at LLM engineers and developers."}]}}