👨🏻‍💻 LLM Engineer Toolkit

This repository contains a curated list of 120+ LLM libraries category wise.

Related Repositories

• 👨🏻‍💻LLM Interview Questions and Answers Hub - 100+ LLM interview questions and answers (basic to advanced).
• 🚀Prompt Engineering Techniques Hub - 25+ prompt engineering techniques with LangChain implementations.
• 🩸LLM, RAG and Agents Survey Papers Collection - Category wise collection of 200+ survey papers.

Stay Updated with Generative AI, LLMs, Agents and RAG.

Join 🚀 AIxFunda free newsletter to get latest updates and interesting tutorials related to Generative AI, LLMs, Agents and RAG.

• ✨ Weekly GenAI updates
• 📄 Weekly LLM, Agents and RAG paper updates
• 📝 1 fresh blog post on an interesting topic every week

Quick links

🚀 LLM Training	🧱 LLM Application Development	🩸LLM RAG
🟩 LLM Inference	🚧 LLM Serving	📤 LLM Data Extraction
🌠 LLM Data Generation	💎 LLM Agents	⚖️ LLM Evaluation
🔍 LLM Monitoring	📅 LLM Prompts	📝 LLM Structured Outputs
🛑 LLM Safety and Security	💠 LLM Embedding Models	❇️ Others

LLM Training and Fine-Tuning

Library	Description	Link
unsloth	Fine-tune LLMs faster with less memory.	Link
PEFT	State-of-the-art Parameter-Efficient Fine-Tuning library.	Link
TRL	Train transformer language models with reinforcement learning.	Link
Transformers	Transformers provides thousands of pretrained models to perform tasks on different modalities such as text, vision, and audio.	Link
Axolotl	Tool designed to streamline post-training for various AI models.	Link
LLMBox	A comprehensive library for implementing LLMs, including a unified training pipeline and comprehensive model evaluation.	Link
LitGPT	Train and fine-tune LLM lightning fast.	Link
Mergoo	A library for easily merging multiple LLM experts, and efficiently train the merged LLM.	Link
Llama-Factory	Easy and efficient LLM f