Home/Evaluation & Observability/openlit

openlit

openlit/openlit

Open-source observability & evaluation platform for AI agents and coding agents

GitHub Website

GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026

75views this month

2.8k stars390 forksLast push Sep 17, 2026 TypeScript Apache-2.0

Decision brief

OpenLIT is an open-source observability and evaluation platform for AI and coding agents, leveraging OpenTelemetry for tracking performance and costs.

Good fit when

When you need to track and evaluate the performance and costs of AI and coding agents using OpenTelemetry.
If your project involves monitoring AI applications across various models, providers, users, sessions, agents, and environments.

Avoid when

If your project does not require observability and evaluation features for AI and coding agents.
When you prefer proprietary tools over open-source solutions.

Pricing:: freemium - OpenLIT is free and open-source under the Apache License 2.0.
Requirements:: Installation is available via pip for Python and npm for TypeScript.

Observed Sep 18, 2026 · Source: enrich:decision_facts

openlit alternatives Trust report

openlit vs evidently openlit vs trulens openlit vs openllmetry

Verify the decision

Adoption

Package downloads where a registry match exists. GitHub stars (2,770) are secondary evidence.

npm downloads (30d): 3,575·npm downloads API·Sep 18, 2026

Maintenance and security

Full trust report

Maintenance: Very active (0d since push); As of Sep 18, 2026
Provenance: Not a fork · Organization account; As of Sep 18, 2026
Security (OSV): No lockfile; As of Sep 18, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

npm install openlit

npm

How it fits your stack(13)

Typed graph edges - alternatives, integrations, successors, and dependencies. Ranked by relationship type, not raw GitHub stars.

Alternative

evidently

Openlit and Evidently both focus on observability in AI engineering, representing alternatives to each other.

alternative

trulens

OpenLit shares a similar focus on AI engineering observability but is more focused on providing a platform with diverse functionalities whereas TruLens specializes in detailed evaluation and monitoring.

alternative

Integrates

langflow

OpenLIT focuses on observability, monitoring, and managing AI tools like LLMs, which aligns with LangFlow’s aim to build and deploy AI agents and workflows.

integrates

Langchain-Chatchat

Both OpenLIT and LangChain-Chatchat are centered around managing LLMs, including observability and workflows, suggesting they can integrate for enhanced AI application management.

integrates

plano

Openlit is designed to enhance observability in the development of AI applications, which can complement Plano’s own observability features for a complete monitoring solution when building and deploying agents.

integrates

pandas-ai

PandasAI and OpenLit both deal with enhancing the observability and monitoring of AI engineering systems but approach this goal from different angles.

cua

Both focus on observability and building/evaluating AI-driven applications.

R2R

OpenLit provides observability tools that might be used to evaluate systems like R2R; both are involved in the broader space of AI engineering infrastructure and evaluation.

Relationship graph

Optional deeper exploration of typed edges and category neighbours.

Similar tools

Same-category neighbours not already linked as typed edges.

langfuse

Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.

35k★

opik

Debug, evaluate, and monitor LLM applications, RAG systems, and agentic workflows

22k★

RagaAI-Catalyst

Python SDK for AI agent observability and evaluation

16k★

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

OpenLIT is an open-source platform for tracking and evaluating the performance and costs of AI agents and coding agents, using OpenTelemetry for observability.

Capability facts

Deploy: Self-host
Source: dockerfile:docker-compose.yml · Sep 18, 2026
Docker: Dockerfile present
Source: dockerfile:docker-compose.yml · Sep 18, 2026
Languages: typescript
Source: github.language · Sep 18, 2026

Graph entities

LangChainframework Guardrails AIframework

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Node.js runtimeNode.js

Source: README excerpt (regex_v1, Sep 18, 2026)

npm install openlit

Source link

Python runtimePython

Source: README excerpt (regex_v1, Sep 18, 2026)

Python:

Source link

README

2. Install the SDK Python: TypeScript: 💰 AI cost observability Track the cost of your AI applications across: <p <img src="https://img.shields.io/badge/ Models 1F2937?style=flat square" alt="Models" <img src="https://img.shields.io/badge/ Providers 1F2937?style=flat square" alt=...

For agents

This page has a .md twin and JSON over the API.

/tools/openlit-openlit.md GET /api/graphcanon/tools/openlit-openlit GET /api/graphcanon/graph?tool=openlit-openlit

openlit

Decision brief

Good fit when

Avoid when

Verify the decision

Adoption

Maintenance and security

Install

How it fits your stack(13)

Alternative

Integrates

Related

Relationship graph

Similar tools

Evidence and technical details

Overview

Capability facts

Categories

Graph entities

Compatibility

Tags

README

For agents