Awesome-LLMOps
tensorchord/Awesome-LLMOps
An awesome & curated list of the best LLMOps tools for developers
Overview
The repository contains a comprehensive collection of resources and tools tailored to developers interested in large language models (LLMs) and their operational management, including frameworks, serving solutions, security measures, training utilities, data solutions, deployment strategies, optimizations, performance tuning, federated learning techniques, and automation approaches.
Categories
Tags
Similar tools
ECC
affaan-m/ECC
The agent harness performance optimization system
hermes-agent
NousResearch/hermes-agent
The self-improving AI agent built by Nous Research
AutoGPT
Significant-Gravitas/AutoGPT
AutoGPT: Build, Deploy, and Run AI Agents
ollama
ollama/ollama
Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
prompts.chat
f/prompts.chat
The world's largest open-source prompt library for AI
transformers
huggingface/transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models
Install
git clone https://github.com/tensorchord/Awesome-LLMOpsREADME
Awesome LLMOps
An awesome & curated list of the best LLMOps tools for developers.
[!NOTE] Contributions are most welcome, please adhere to the contribution guidelines.
Table of Contents
- Awesome LLMOps
- Table of Contents
- Model
- Large Language Model
- CV Foundation Model
- Audio Foundation Model
- Robotics Foundation Model
- Serving
- Large Model Serving
- Frameworks/Servers for Serving
- Security
- Frameworks for LLM security
- Observability
- LLMOps
- Search
- Vector search
- Code AI
- Training
- IDEs and Workspaces
- Foundation Model Fine Tuning
- Frameworks for Training
- Experiment Tracking
- Visualization
- Model Editing
- Data
- Data Management
- Data Storage
- Data Tracking
- Feature Engineering
- Data/Feature enrichment
- Large Scale Deployment
- ML Platforms
- Workflow
- Scheduling
- Model Management
- Performance
- ML Compiler
- Profiling
- AutoML
- Optimizations
- Federated ML
- Awesome Lists
Model
Large Language Model
| Project | Details | Repository |
|---|---|---|
| Alpaca | Code and documentation to train Stanford's Alpaca models, and generate the data. | |
| BELLE | A 7B Large Language Model fine-tune by 34B Chinese Character Corpus, based on LLaMA and Alpaca. | |
| Bloom | BigScience Large Open-science Open-access Multilingual Language Model | |
| dolly | Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform |