LLM-Engineers-Handbook
PacktPublishing/LLM-Engineers-Handbook
The LLM's practical guide: From the fundamentals to deploying advanced LLM and RAG apps to AWS using LLMOps best practices
The LLM's practical guide: From the fundamentals to deploying advanced LLM and RAG apps to AWS using LLMOps best practices
Categories
Tags
Similar tools
ollama
ollama/ollama
Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
prompts.chat
f/prompts.chat
The world's largest open-source prompt library for AI
transformers
huggingface/transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models
open-webui
open-webui/open-webui
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
awesome-llm-apps
Shubhamsaboo/awesome-llm-apps
100+ AI Agent & RAG apps you can actually run — clone, customize, ship.
LLMs-from-scratch
rasbt/LLMs-from-scratch
Implement a ChatGPT-like LLM in PyTorch from scratch
Install
pip install LLM-Engineers-HandbookREADME
👷 LLM Engineer's Handbook
Official repository of the LLM Engineer's Handbook by Paul Iusztin and Maxime Labonne
Find the book on Amazon or Packt
🌟 Features
The goal of this book is to create your own end-to-end LLM-based system using best practices:
- 📝 Data collection & generation
- 🔄 LLM training pipeline
- 📊 Simple RAG system
- 🚀 Production-ready AWS deployment
- 🔍 Comprehensive monitoring
- 🧪 Testing and evaluation framework
You can download and use the final trained model on Hugging Face.
[!IMPORTANT] The code in this GitHub repository is actively maintained and may contain updates not reflected in the book. Always refer to this repository for the latest version of the code.
🔗 Dependencies
Local dependencies
To install and run the project locally, you need the following dependencies.
| Tool | Version | Purpose | Installation Link |
|---|---|---|---|
| pyenv | ≥2.3.36 | Multiple Python versions (optional) | Install Guide |
| Python | 3.11 | Runtime environment | Download |
| Poetry | >= 1.8.3 and < 2.0 | Package management | Install Guide |
| Docker | ≥27.1.1 | Containerization | Install Guide |
| AWS CLI | ≥2.15.42 | Cloud management | Install Guide |
| Git | ≥2.44.0 | Version control | Download |
Cloud services
The code also uses and depends on the following cloud services. For now, you don't have to do anything. We will guide you in the installation and deployment sections on how to use them:
| Service | Purpose |
|---|---|
| HuggingFace | Model registry |
| Comet ML | Experiment tracker |
| Opik | Prompt monitoring |
| ZenML | Orchestrator and artifacts layer |
| AWS | Compute and storage |
| MongoDB | NoSQL database |
| Qdrant | Vector database |
| GitHub Actions | CI/CD pipeline |
In the LLM Engineer's Handbook, Chapter 2 will walk you through each tool. Chapters 10 and 11 provide step-by-step guides on how to set up everything you need.
🗂️ Project Structure
Here is the directory overview:
.
├── code_snippets/ # Standalone exampl