langtrace
Scale3-Labs/langtrace
Langtrace π is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evalu
Langtrace π is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations and metrics for popular LLMs, LLM frameworks, vectorDBs and more.. Integrate using Typescript, Python. ππ»π
Categories
Tags
Similar tools
ollama
ollama/ollama
Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
prompts.chat
f/prompts.chat
The world's largest open-source prompt library for AI
transformers
huggingface/transformers
π€ Transformers: the model-definition framework for state-of-the-art machine learning models
open-webui
open-webui/open-webui
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
awesome-llm-apps
Shubhamsaboo/awesome-llm-apps
100+ AI Agent & RAG apps you can actually run β clone, customize, ship.
LLMs-from-scratch
rasbt/LLMs-from-scratch
Implement a ChatGPT-like LLM in PyTorch from scratch
Install
npm install langtraceREADME
Langtrace
Open Source Observability for LLM Applications
π Table of Contents
- β¨ Features
- π Quick Start
- π Integrations
- π Getting Started
- π Self Hosting
- π Architecture
- π€ Contributing
- π Security
- β FAQ
- π₯ Contributors
- π License
Langtrace is an open source observability software which lets you capture, debug and analyze traces and metrics from all your applications that leverages LLM APIs, Vector Databases and LLM based Frameworks.
β¨ Features
- π Open Telemetry Support: Built on OTEL standards for comprehensive tracing
- π Real-time Monitoring: Track LLM API calls, vector operations, and framework usage
- π― Performance Insights: Analyze latency, costs, and usage patterns
- π Debug Tools: Trace and debug your LLM application workflows
- π Analytics: Get detailed metrics and visualizations
- π Self-hosting Option: Deploy on your own infrastructure
π Quick Start
# For TypeScript/JavaScript
npm i @langtrase/typescript-sdk
# For Python
pip install langtrace-python-sdk
Initialize in your code:
// TypeScript
import * as Langtrace from '@langtrase/typescript-sdk'
Langtrace.init({ api_key: '<your_api_key>' }) // Get your API key at langtrace.ai
# Python
from langtrace_python_sdk import langtrace
langtrace.init(api_key='<your_api_key>') # Get your API key at langtrace.ai
For detailed setup instructions, see Getting Started.
π Open Telemetry Support
The traces generated by Langtrace adhere to Open Telemetry Standards(OTEL). We are developing semantic conventions for the traces generated by this project. You can checkout the current definitions in this repository. Note: This is an ongoing development and we encourage you to get involved and welcome your feedback.
π¦ SDK Repositories
π Getting Started
Langtrace Cloud βοΈ
To use the managed SaaS version of Langtrace, follow the steps below:
- Sign up by going to this link.
- Create a new Project after signing up. Projects are containers for storing traces and metrics generated by your application. If you have only one application, creating 1 project will do.
- Generate an API key by going inside the project.
- In your application, install the Langtrace SDK and initialize it with the API key you generated in the step 3.
- The code for installing and setting up the SDK is shown below:
If your application is built using typescript/javascript
npm i @langtrase/typescript-sdk
import * as Langtrace from '@langtrase/typescript-sdk' // Must precede any llm module imports
Langtrace.init({ api_key: <your_api_key> })
OR
import * as Langtrace from "@langtrase/typescript-sdk"; // Must precede any llm module imports
LangTrace.init(); // LANGTRACE_API_KEY as an ENVIRONMENT variable
If your application is built using python
pip install langtrace-python-sdk
from