openinference

Arize-ai/openinference

OpenTelemetry Instrumentation for AI Observability

1.1k
Stars
266
Forks
208
Open issues
15
Watchers
Python Apache-2.0Last pushed Jul 7, 2026

Overview

A repository providing OpenTelemetry instrumentation to monitor and observe AI systems, contributing to effective AI operations (AIops).

Categories

Tags

Similar tools

Install

pip install openinference

README

OpenInference

OpenInference is a set of conventions and plugins that is complimentary to OpenTelemetry to enable tracing of AI applications. OpenInference is natively supported by Arize Phoenix and Arize AX, but can be used with any OpenTelemetry-compatible backend as well.

Specification

The OpenInference specification is edited in markdown files found in the spec directory. It's designed to provide insight into the invocation of LLMs and the surrounding application context such as retrieval from vector stores and the usage of external tools such as search engines or APIs. The specification is transport and file-format agnostic, and is intended to be used in conjunction with other specifications such as JSON, ProtoBuf, and DataFrames.

Instrumentation

OpenI