helicone
Helicone/helicone
๐ง Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 ๐
๐ง Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 ๐
Categories
Tags
Similar tools
ECC
affaan-m/ECC
The agent harness performance optimization system
hermes-agent
NousResearch/hermes-agent
The self-improving AI agent built by Nous Research
AutoGPT
Significant-Gravitas/AutoGPT
AutoGPT: Build, Deploy, and Run AI Agents
ollama
ollama/ollama
Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
prompts.chat
f/prompts.chat
The world's largest open-source prompt library for AI
transformers
huggingface/transformers
๐ค Transformers: the model-definition framework for state-of-the-art machine learning models
Install
npm install heliconeREADME
| ๐ Observability | ๐ธ๏ธ Agent Tracing | ๐ LLM Routing |
|---|---|---|
| ๐ฐ Cost & Latency Tracking | ๐ Datasets & Fine-tuning | ๐๏ธ Automatic Fallbacks |
Docs โข Changelog โข Bug reports โข See Helicone in Action! (Free)
Helicone is an AI Gateway & LLM Observability Platform for AI Engineers
- ๐ AI Gateway: Access 100+ AI models with 1 API key through the OpenAI API with intelligent routing and automatic fallbacks. Get started in 2 minutes.
- ๐ Quick integration: One-line of code to log all your requests from OpenAI, Anthropic, LangChain, Gemini, Vercel AI SDK, and more.
- ๐ Observe: Inspect and debug traces & sessions for agents, chatbots, document processing pipelines, and more
- ๐ Analyze: Track metrics like cost, latency, quality, and more. Export to PostHog in one-line for custom dashboards
- ๐ฎ Playground: Rapidly test and iterate on prompts, sessions and traces in our UI.
- ๐ง Prompt Management: Version prompts using production data. Deploy prompts through the AI Gateway without code changes. Your prompts remain under your control, always accessible.
- ๐๏ธ Fine-tune: Fine-tune with one of our fine-tuning partners: OpenPipe or Autonomi (more coming soon)
- ๐ก๏ธ Enterprise Ready: SOC 2 and GDPR compliant
๐ Generous monthly free tier (10k requests/month) - No credit card required!
Quick Start โก๏ธ
-
Get your API key by signing up here and add credits at helicone.ai/credits
-
Update the
baseURLin your code and add your API key.import OpenAI from "openai"; const client = new OpenAI({ baseURL: