pezzo
pezzolabs/pezzo
Developer-first LLMOps platform
Overview
Pezzo is an open-source, cloud-native LLMOps platform designed to streamline the development and management of language models. It supports features such as prompt design, version management, collaboration, observability, and cost optimization for AI operations.
Categories
Tags
Similar tools
ECC
affaan-m/ECC
The agent harness performance optimization system
AutoGPT
Significant-Gravitas/AutoGPT
AutoGPT: Build, Deploy, and Run AI Agents
ollama
ollama/ollama
Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
prompts.chat
f/prompts.chat
The world's largest open-source prompt library for AI
transformers
huggingface/transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models
JavaGuide
Snailclimb/JavaGuide
Snailclimb/JavaGuide: 面试 & 后端通用面试指南,覆盖计算机基础、数据库、分布式、高并发、系统设计与 AI 应用开发
Install
npm install pezzoREADME
Pezzo is a fully cloud-native and open-source LLMOps platform. Seamlessly observe and monitor your AI operations, troubleshoot issues, save up to 90% on costs and latency, collaborate and manage your prompts in one place, and instantly deliver AI changes.
✨ Features
Documentation
Click here to navigate to the Official Pezzo Documentation
In the documentation, you can find information on how to use Pezzo, its architecture, including tutorials and recipes for varius use cases and LLM providers.
Supported Clients
| Feature | Node.js • Docs | Python • Docs | LangChain |
|---|---|---|---|
| Prompt Management | ✅ | ✅ | ✅ |
| Observability | ✅ | ✅ | ✅ |
| Caching | ✅ | ✅ | ✅ |
Looking for a client that's not listed here? Open an issue and let us know!
Getting Started - Docker Compose
If you simply want to run the full Pezzo stack locally, check out Running With Docker Compose in the documentation.
If you want to run Pezzo in development mode, continue reading.
Prerequisites
- Node.js 18+
- Docker
- (Recommended) GraphQL Language Feature Support VSCode Extension