{"data":{"node":{"slug":"helicone-helicone","name":"helicone","tagline":"Open source LLM observability platform","github_url":"https://github.com/Helicone/helicone","owner":"Helicone","repo":"helicone","owner_avatar_url":"https://avatars.githubusercontent.com/u/114524975?v=4","primary_language":"TypeScript","stars":6162,"forks":670,"topics":["agent-monitoring","analytics","evaluation","gpt","langchain","large-language-models","llama-index","llm","llm-cost","llm-evaluation","llm-observability","llmops","monitoring","open-source","openai","playground","prompt-engineering","prompt-management","ycombinator"],"archived":false,"github_pushed_at":"2026-09-16T19:29:27+00:00","maintenance_label":"Very active","stars_delta_30d":89,"url":"https://www.graphcanon.com/tools/helicone-helicone","markdown_url":"https://www.graphcanon.com/tools/helicone-helicone.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/helicone-helicone","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=helicone-helicone"},"categories":[{"slug":"evaluation-observability","name":"Evaluation & Observability","url":"https://www.graphcanon.com/categories/evaluation-observability","markdown_url":"https://www.graphcanon.com/categories/evaluation-observability.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/evaluation-observability"}],"tags":[{"slug":"agent-monitoring","name":"agent-monitoring"},{"slug":"analytics","name":"analytics"},{"slug":"evaluation","name":"evaluation"},{"slug":"gpt","name":"gpt"},{"slug":"langchain","name":"langchain"},{"slug":"large-language-models","name":"large-language-models"},{"slug":"llama-index","name":"llama-index"},{"slug":"llm-cost","name":"llm-cost"}],"edges":[{"type":"related","direction":"out","explanation":"Helicone can integrate with Onyx to provide observability and metrics for the LLMs used within its platform, helping developers understand performance and usage.","successor_context":null,"tool":{"slug":"onyx-dot-app-onyx","name":"onyx","tagline":"Open Source AI Platform - AI Chat with advanced features that works with every LLM","github_url":"https://github.com/onyx-dot-app/onyx","owner":"onyx-dot-app","repo":"onyx","owner_avatar_url":"https://avatars.githubusercontent.com/u/131946000?v=4","primary_language":"Python","stars":32153,"forks":4477,"topics":["ai","ai-chat","chatgpt","chatui","enterprise-search","gen-ai","information-retrieval","llm","llm-ui","nextjs","python","rag","self-hosted","vector-search"],"archived":false,"github_pushed_at":"2026-09-18T05:39:36+00:00","maintenance_label":"Very active","stars_delta_30d":536,"url":"https://www.graphcanon.com/tools/onyx-dot-app-onyx","markdown_url":"https://www.graphcanon.com/tools/onyx-dot-app-onyx.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/onyx-dot-app-onyx","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=onyx-dot-app-onyx"}},{"type":"alternative","direction":"out","explanation":"Helicone and promptfoo both serve to evaluate Large Language Models (LLMs), with Helicone focusing on monitoring, experimentation, and routing across multiple models via an API, while promptfoo emphasizes CLI tools and libraries for comprehensive testing and red-teaming of LLM applications.","successor_context":null,"tool":{"slug":"promptfoo-promptfoo","name":"promptfoo","tagline":"Test prompts, agents, and RAGs. Compare performance of various LLMs.","github_url":"https://github.com/promptfoo/promptfoo","owner":"promptfoo","repo":"promptfoo","owner_avatar_url":"https://avatars.githubusercontent.com/u/137907881?v=4","primary_language":"TypeScript","stars":25251,"forks":2334,"topics":["ci","ci-cd","cicd","evaluation","evaluation-framework","llm","llm-eval","llm-evaluation","llm-evaluation-framework","llmops","pentesting","prompt-engineering","prompt-testing","prompts","rag","red-teaming","testing","vulnerability-scanners"],"archived":false,"github_pushed_at":"2026-09-18T07:59:45+00:00","maintenance_label":"Very active","stars_delta_30d":1413,"url":"https://www.graphcanon.com/tools/promptfoo-promptfoo","markdown_url":"https://www.graphcanon.com/tools/promptfoo-promptfoo.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/promptfoo-promptfoo","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=promptfoo-promptfoo"}},{"type":"related","direction":"out","explanation":"Both Helicone and LiteLLM aim to simplify access to a wide range of language models, with slight differences in how they implement this simplification.","successor_context":null,"tool":{"slug":"berriai-litellm","name":"litellm","tagline":"The fastest, lightest AI Gateway","github_url":"https://github.com/BerriAI/litellm","owner":"BerriAI","repo":"litellm","owner_avatar_url":"https://avatars.githubusercontent.com/u/121462774?v=4","primary_language":"Python","stars":59051,"forks":11547,"topics":["ai-gateway","anthropic","azure-openai","bedrock","gateway","langchain","litellm","llm","llm-gateway","llmops","mcp-gateway","openai","openai-proxy","rust","rust-ai","vertex-ai"],"archived":false,"github_pushed_at":"2026-09-18T08:06:17+00:00","maintenance_label":"Very active","stars_delta_30d":3830,"url":"https://www.graphcanon.com/tools/berriai-litellm","markdown_url":"https://www.graphcanon.com/tools/berriai-litellm.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/berriai-litellm","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=berriai-litellm"}},{"type":"alternative","direction":"out","explanation":"Both Helicone and Langfuse are observability platforms for AI/LLMs providing evaluation, metrics, and monitoring.","successor_context":null,"tool":{"slug":"langfuse-langfuse","name":"langfuse","tagline":"Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.","github_url":"https://github.com/langfuse/langfuse","owner":"langfuse","repo":"langfuse","owner_avatar_url":"https://avatars.githubusercontent.com/u/134601687?v=4","primary_language":"TypeScript","stars":34763,"forks":3793,"topics":["analytics","autogen","evaluation","langchain","large-language-models","llama-index","llm","llm-evaluation","llm-observability","llmops","monitoring","observability","open-source","openai","playground","prompt-engineering","prompt-management","self-hosted","ycombinator"],"archived":false,"github_pushed_at":"2026-09-18T08:08:19+00:00","maintenance_label":"Very active","stars_delta_30d":2492,"url":"https://www.graphcanon.com/tools/langfuse-langfuse","markdown_url":"https://www.graphcanon.com/tools/langfuse-langfuse.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/langfuse-langfuse","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=langfuse-langfuse"}},{"type":"related","direction":"out","explanation":"Both Helicone and Langfuse focus on observability, metrics, and management for LLMs, although they approach it in slightly different ways.","successor_context":null,"tool":{"slug":"langfuse-langfuse","name":"langfuse","tagline":"Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.","github_url":"https://github.com/langfuse/langfuse","owner":"langfuse","repo":"langfuse","owner_avatar_url":"https://avatars.githubusercontent.com/u/134601687?v=4","primary_language":"TypeScript","stars":34763,"forks":3793,"topics":["analytics","autogen","evaluation","langchain","large-language-models","llama-index","llm","llm-evaluation","llm-observability","llmops","monitoring","observability","open-source","openai","playground","prompt-engineering","prompt-management","self-hosted","ycombinator"],"archived":false,"github_pushed_at":"2026-09-18T08:08:19+00:00","maintenance_label":"Very active","stars_delta_30d":2492,"url":"https://www.graphcanon.com/tools/langfuse-langfuse","markdown_url":"https://www.graphcanon.com/tools/langfuse-langfuse.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/langfuse-langfuse","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=langfuse-langfuse"}},{"type":"alternative","direction":"out","explanation":"Both Helicone and Evidently provide observability solutions for machine learning models and LLMs.","successor_context":null,"tool":{"slug":"evidentlyai-evidently","name":"evidently","tagline":"An open-source ML and LLM observability framework for evaluating, testing, and monitoring AI systems and data pipelines.","github_url":"https://github.com/evidentlyai/evidently","owner":"evidentlyai","repo":"evidently","owner_avatar_url":"https://avatars.githubusercontent.com/u/75031056?v=4","primary_language":"Jupyter Notebook","stars":7924,"forks":919,"topics":["data-drift","data-quality","data-science","data-validation","generative-ai","hacktoberfest","html-report","jupyter-notebook","llm","llmops","machine-learning","mlops","model-monitoring","pandas-dataframe"],"archived":false,"github_pushed_at":"2026-09-11T09:03:28+00:00","maintenance_label":"Very active","stars_delta_30d":134,"url":"https://www.graphcanon.com/tools/evidentlyai-evidently","markdown_url":"https://www.graphcanon.com/tools/evidentlyai-evidently.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/evidentlyai-evidently","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=evidentlyai-evidently"}},{"type":"alternative","direction":"out","explanation":"Both Helicone and Phoenix offer AI Observability & Evaluation services for large language models and agents.","successor_context":null,"tool":{"slug":"arize-ai-phoenix","name":"phoenix","tagline":"AI Observability & Evaluation","github_url":"https://github.com/Arize-ai/phoenix","owner":"Arize-ai","repo":"phoenix","owner_avatar_url":"https://avatars.githubusercontent.com/u/59858760?v=4","primary_language":"Python","stars":11528,"forks":1136,"topics":["agents","ai-monitoring","ai-observability","aiengineering","anthropic","datasets","evals","langchain","llamaindex","llm-eval","llm-evaluation","llmops","llms","openai","prompt-engineering","smolagents"],"archived":false,"github_pushed_at":"2026-09-18T07:31:21+00:00","maintenance_label":"Very active","stars_delta_30d":681,"url":"https://www.graphcanon.com/tools/arize-ai-phoenix","markdown_url":"https://www.graphcanon.com/tools/arize-ai-phoenix.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/arize-ai-phoenix","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=arize-ai-phoenix"}},{"type":"related","direction":"out","explanation":"Helicone can be used alongside Khoj to monitor and evaluate the performance of LLMs, including how they function as a 'second brain' tool.","successor_context":null,"tool":{"slug":"khoj-ai-khoj","name":"khoj","tagline":"Self-hostable AI second brain for personalized research and automation","github_url":"https://github.com/khoj-ai/khoj","owner":"khoj-ai","repo":"khoj","owner_avatar_url":"https://avatars.githubusercontent.com/u/134046886?v=4","primary_language":"Python","stars":37399,"forks":2484,"topics":["agent","ai","assistant","chat","chatgpt","emacs","image-generation","llama3","llamacpp","llm","obsidian","obsidian-md","offline-llm","productivity","rag","research","self-hosted","semantic-search","stt","whatsapp-ai"],"archived":false,"github_pushed_at":"2026-08-02T01:55:40+00:00","maintenance_label":"Steady","stars_delta_30d":887,"url":"https://www.graphcanon.com/tools/khoj-ai-khoj","markdown_url":"https://www.graphcanon.com/tools/khoj-ai-khoj.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/khoj-ai-khoj","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=khoj-ai-khoj"}},{"type":"alternative","direction":"out","explanation":"Helicone and Opik both offer AI observability, evaluation, and optimization services.","successor_context":null,"tool":{"slug":"comet-ml-opik","name":"opik","tagline":"Debug, evaluate, and monitor LLM applications, RAG systems, and agentic workflows","github_url":"https://github.com/comet-ml/opik","owner":"comet-ml","repo":"opik","owner_avatar_url":"https://avatars.githubusercontent.com/u/31487821?v=4","primary_language":"Python","stars":22110,"forks":1801,"topics":["evaluation","hacktoberfest","hacktoberfest2025","langchain","llama-index","llm","llm-evaluation","llm-observability","llmops","open-source","openai","playground","prompt-engineering"],"archived":false,"github_pushed_at":"2026-09-18T08:25:51+00:00","maintenance_label":"Very active","stars_delta_30d":933,"url":"https://www.graphcanon.com/tools/comet-ml-opik","markdown_url":"https://www.graphcanon.com/tools/comet-ml-opik.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/comet-ml-opik","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=comet-ml-opik"}},{"type":"related","direction":"out","explanation":null,"successor_context":null,"tool":{"slug":"agenta-ai-agenta","name":"agenta","tagline":"A workspace for building and orchestrating AI agents and automations.","github_url":"https://github.com/Agenta-AI/agenta","owner":"Agenta-AI","repo":"agenta","owner_avatar_url":"https://avatars.githubusercontent.com/u/127993667?v=4","primary_language":"TypeScript","stars":4764,"forks":673,"topics":["agent-builder","agent-observability","agent-orchestration","agent-workspace","agentic-ai","ai-agent","ai-agents","ai-automation","ai-coworker","ai-skills-manager","ai-workflow-builder","harness","mcp","open-source","self-hosted","workflow-automation"],"archived":false,"github_pushed_at":"2026-09-18T06:32:52+00:00","maintenance_label":"Very active","stars_delta_30d":319,"url":"https://www.graphcanon.com/tools/agenta-ai-agenta","markdown_url":"https://www.graphcanon.com/tools/agenta-ai-agenta.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/agenta-ai-agenta","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=agenta-ai-agenta"}},{"type":"alternative","direction":"out","explanation":"Helicone and OpenLLMetry are both focused on providing open-source observability tools for LLM applications.","successor_context":null,"tool":{"slug":"traceloop-openllmetry","name":"openllmetry","tagline":"Open-source observability for GenAI or LLM applications based on OpenTelemetry","github_url":"https://github.com/traceloop/openllmetry","owner":"traceloop","repo":"openllmetry","owner_avatar_url":"https://avatars.githubusercontent.com/u/125419530?v=4","primary_language":"Python","stars":7438,"forks":1082,"topics":["artifical-intelligence","datascience","generative-ai","good-first-issue","good-first-issues","help-wanted","llm","llmops","metrics","ml","model-monitoring","monitoring","observability","open-source","open-telemetry","opentelemetry","opentelemetry-python","python"],"archived":false,"github_pushed_at":"2026-09-17T18:54:33+00:00","maintenance_label":"Very active","stars_delta_30d":61,"url":"https://www.graphcanon.com/tools/traceloop-openllmetry","markdown_url":"https://www.graphcanon.com/tools/traceloop-openllmetry.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/traceloop-openllmetry","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=traceloop-openllmetry"}},{"type":"related","direction":"out","explanation":null,"successor_context":null,"tool":{"slug":"traceloop-openllmetry","name":"openllmetry","tagline":"Open-source observability for GenAI or LLM applications based on OpenTelemetry","github_url":"https://github.com/traceloop/openllmetry","owner":"traceloop","repo":"openllmetry","owner_avatar_url":"https://avatars.githubusercontent.com/u/125419530?v=4","primary_language":"Python","stars":7438,"forks":1082,"topics":["artifical-intelligence","datascience","generative-ai","good-first-issue","good-first-issues","help-wanted","llm","llmops","metrics","ml","model-monitoring","monitoring","observability","open-source","open-telemetry","opentelemetry","opentelemetry-python","python"],"archived":false,"github_pushed_at":"2026-09-17T18:54:33+00:00","maintenance_label":"Very active","stars_delta_30d":61,"url":"https://www.graphcanon.com/tools/traceloop-openllmetry","markdown_url":"https://www.graphcanon.com/tools/traceloop-openllmetry.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/traceloop-openllmetry","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=traceloop-openllmetry"}},{"type":"related","direction":"in","explanation":null,"successor_context":null,"tool":{"slug":"vectordotdev-vector","name":"vector","tagline":"A high-performance observability data pipeline","github_url":"https://github.com/vectordotdev/vector","owner":"vectordotdev","repo":"vector","owner_avatar_url":"https://avatars.githubusercontent.com/u/16866914?v=4","primary_language":"Rust","stars":22396,"forks":2258,"topics":["agent","cloud-native","data-transformation","datadog","etl","events","forwarder","hacktoberfest","high-performance","logs","metrics","monitoring","observability","pipelines","rust-lang","stream-processing","telemetry","traces"],"archived":false,"github_pushed_at":"2026-08-18T21:55:24+00:00","maintenance_label":"Very active","stars_delta_30d":198,"url":"https://www.graphcanon.com/tools/vectordotdev-vector","markdown_url":"https://www.graphcanon.com/tools/vectordotdev-vector.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/vectordotdev-vector","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=vectordotdev-vector"}},{"type":"related","direction":"in","explanation":null,"successor_context":null,"tool":{"slug":"arize-ai-phoenix","name":"phoenix","tagline":"AI Observability & Evaluation","github_url":"https://github.com/Arize-ai/phoenix","owner":"Arize-ai","repo":"phoenix","owner_avatar_url":"https://avatars.githubusercontent.com/u/59858760?v=4","primary_language":"Python","stars":11528,"forks":1136,"topics":["agents","ai-monitoring","ai-observability","aiengineering","anthropic","datasets","evals","langchain","llamaindex","llm-eval","llm-evaluation","llmops","llms","openai","prompt-engineering","smolagents"],"archived":false,"github_pushed_at":"2026-09-18T07:31:21+00:00","maintenance_label":"Very active","stars_delta_30d":681,"url":"https://www.graphcanon.com/tools/arize-ai-phoenix","markdown_url":"https://www.graphcanon.com/tools/arize-ai-phoenix.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/arize-ai-phoenix","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=arize-ai-phoenix"}},{"type":"alternative","direction":"in","explanation":"Helicone provides tracking and evaluation of AI agents, a space that overlaps significantly with what Langtrace offers for LLM observability.","successor_context":null,"tool":{"slug":"scale3-labs-langtrace","name":"langtrace","tagline":"Open Telemetry based observability tool for LLM applications","github_url":"https://github.com/Scale3-Labs/langtrace","owner":"Scale3-Labs","repo":"langtrace","owner_avatar_url":"https://avatars.githubusercontent.com/u/110545750?v=4","primary_language":"TypeScript","stars":1232,"forks":127,"topics":["ai","datasets","evaluations","gpt","langchain","llm","llm-framework","llmops","observability","open-source","open-telemetry","openai","prompt-engineering","tracing"],"archived":false,"github_pushed_at":"2025-11-17T15:08:48+00:00","maintenance_label":"Slowing","stars_delta_30d":4,"url":"https://www.graphcanon.com/tools/scale3-labs-langtrace","markdown_url":"https://www.graphcanon.com/tools/scale3-labs-langtrace.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/scale3-labs-langtrace","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=scale3-labs-langtrace"}},{"type":"alternative","direction":"in","explanation":"Evidently and Helicone both serve the purpose of monitoring and evaluating AI systems, particularly focusing on large language models (LLMs). While Evidently provides a broad framework for observability that includes 100+ metrics applicable to various types of AI systems including LLMs, Helicone specializes in simplifying the integration and monitoring process specifically for LLMs through unified","successor_context":null,"tool":{"slug":"evidentlyai-evidently","name":"evidently","tagline":"An open-source ML and LLM observability framework for evaluating, testing, and monitoring AI systems and data pipelines.","github_url":"https://github.com/evidentlyai/evidently","owner":"evidentlyai","repo":"evidently","owner_avatar_url":"https://avatars.githubusercontent.com/u/75031056?v=4","primary_language":"Jupyter Notebook","stars":7924,"forks":919,"topics":["data-drift","data-quality","data-science","data-validation","generative-ai","hacktoberfest","html-report","jupyter-notebook","llm","llmops","machine-learning","mlops","model-monitoring","pandas-dataframe"],"archived":false,"github_pushed_at":"2026-09-11T09:03:28+00:00","maintenance_label":"Very active","stars_delta_30d":134,"url":"https://www.graphcanon.com/tools/evidentlyai-evidently","markdown_url":"https://www.graphcanon.com/tools/evidentlyai-evidently.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/evidentlyai-evidently","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=evidentlyai-evidently"}}],"neighbours":[{"slug":"langfuse-langfuse","name":"langfuse","tagline":"Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.","github_url":"https://github.com/langfuse/langfuse","owner":"langfuse","repo":"langfuse","owner_avatar_url":"https://avatars.githubusercontent.com/u/134601687?v=4","primary_language":"TypeScript","stars":34763,"forks":3793,"topics":["analytics","autogen","evaluation","langchain","large-language-models","llama-index","llm","llm-evaluation","llm-observability","llmops","monitoring","observability","open-source","openai","playground","prompt-engineering","prompt-management","self-hosted","ycombinator"],"archived":false,"github_pushed_at":"2026-09-18T08:08:19+00:00","maintenance_label":"Active","url":"https://www.graphcanon.com/tools/langfuse-langfuse","markdown_url":"https://www.graphcanon.com/tools/langfuse-langfuse.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/langfuse-langfuse","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=langfuse-langfuse","shared_categories":["evaluation-observability"]},{"slug":"stanford-crfm-helm","name":"helm","tagline":"Holistic, reproducible and transparent evaluation of foundation models","github_url":"https://github.com/stanford-crfm/helm","owner":"stanford-crfm","repo":"helm","owner_avatar_url":"https://avatars.githubusercontent.com/u/75054807?v=4","primary_language":"Python","stars":2939,"forks":421,"topics":[],"archived":false,"github_pushed_at":"2026-09-01T01:33:19+00:00","maintenance_label":"Steady","url":"https://www.graphcanon.com/tools/stanford-crfm-helm","markdown_url":"https://www.graphcanon.com/tools/stanford-crfm-helm.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/stanford-crfm-helm","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=stanford-crfm-helm","shared_categories":["evaluation-observability"]},{"slug":"openlit-openlit","name":"openlit","tagline":"Open-source observability & evaluation platform for AI agents and coding agents","github_url":"https://github.com/openlit/openlit","owner":"openlit","repo":"openlit","owner_avatar_url":"https://avatars.githubusercontent.com/u/149867240?v=4","primary_language":"TypeScript","stars":2770,"forks":390,"topics":["ai-engineering","ai-evaluation","ai-observability","ai-observability-platform","amd-gpu","claude-code","clickhouse","codex","coding-agent","coding-agents","cursor","genai","gpu-monitoring","llm-observability","llmops","nvidia-smi","observability","open-source","openai","opentelemetry"],"archived":false,"github_pushed_at":"2026-09-17T21:59:22+00:00","maintenance_label":"Active","url":"https://www.graphcanon.com/tools/openlit-openlit","markdown_url":"https://www.graphcanon.com/tools/openlit-openlit.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/openlit-openlit","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=openlit-openlit","shared_categories":["evaluation-observability"]},{"slug":"langfuse-oss-llmops-stack","name":"oss-llmops-stack","tagline":"Modular open source LLMOps stack for LLM API unification, observability and prompt management","github_url":"https://github.com/langfuse/oss-llmops-stack","owner":"langfuse","repo":"oss-llmops-stack","owner_avatar_url":"https://avatars.githubusercontent.com/u/134601687?v=4","primary_language":null,"stars":152,"forks":8,"topics":["ai-gateway","gateway","llm","llm-evaluation","llm-gateway","llm-observability","llmops","monitoring","open-source","openai-proxy","prompt-management","self-hosted","ycombinator"],"archived":false,"github_pushed_at":"2026-07-28T15:43:33+00:00","maintenance_label":"Steady","url":"https://www.graphcanon.com/tools/langfuse-oss-llmops-stack","markdown_url":"https://www.graphcanon.com/tools/langfuse-oss-llmops-stack.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/langfuse-oss-llmops-stack","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=langfuse-oss-llmops-stack","shared_categories":["evaluation-observability"]},{"slug":"netis-heron","name":"heron","tagline":"Performance monitoring tool for LLM APIs and AI agents","github_url":"https://github.com/Netis/heron","owner":"Netis","repo":"heron","owner_avatar_url":"https://avatars.githubusercontent.com/u/5688247?v=4","primary_language":"Rust","stars":101,"forks":10,"topics":["agentic-ai","ai-agent-development","ai-observability","libpcap","litellm","llm-monitoring","llm-observability","llmops","observability","ollama","packet-capture","rust","sglang","vllm"],"archived":false,"github_pushed_at":"2026-08-18T08:24:47+00:00","maintenance_label":"Steady","url":"https://www.graphcanon.com/tools/netis-heron","markdown_url":"https://www.graphcanon.com/tools/netis-heron.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/netis-heron","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=netis-heron","shared_categories":["evaluation-observability"]}]}}