openllmetry
traceloop/openllmetry
Open-source observability for your LLM application
Overview
OpenLLMetry is an open-source tool designed to enhance observability in LLM applications, leveraging OpenTelemetry.
Categories
Tags
Similar tools
langflow
langflow-ai/langflow
Langflow is a powerful platform for building and deploying AI-powered agents and workflows.
worldmonitor
koala73/worldmonitor
Real-time global intelligence dashboard
TrendRadar
sansan0/TrendRadar
告别信息过载，你的AI舆情监控助手与热点筛选工具
graphrag
microsoft/graphrag
A modular graph-based Retrieval-Augmented Generation (RAG) system
langfuse
langfuse/langfuse
Langfuse: Open source AI engineering platform for LLM evaluation, observability, and prompt management.
RAG_Techniques
NirDiamant/RAG_Techniques
Advanced RAG Techniques
Install
pip install openllmetryREADME
Open-source observability for your LLM application
Get started »
Slack |
Docs |
Website
🎉 New: Our semantic conventions are now part of OpenTelemetry! Join the discussion and help us shape the future of LLM observability.
Looking for the JS/TS version? Check out OpenLLMetry-JS.
OpenLLMetry is a set of extensions built on top of OpenTelemetry that gives you complete observability over your LLM application. Because it uses OpenTelemetry under the hood, it can be connected to your existing observability solutions - Datadog, Honeycomb, and others.
It's built and maintained by Traceloop under the Apache 2.0 license.
The repo contains standard OpenTelemetry instrumentations for LLM providers and Vector DBs, as well as a Traceloop SDK that makes it easy to get started with OpenLLMetry, while still outputting standard OpenTelemetry data that can be connected to your observability stack. If you already have OpenTelemetry instrumented, you can just add any of our instrumentations directly.
🚀 Getting Started
The easiest way to get started is to use our SDK. For a complete guide, go to our docs.
Install the SDK:
pip install traceloop-sdk
Then, to start instrumenting your code, just add this line to your code: