{"data":{"node":{"slug":"openlit-openlit","name":"openlit","tagline":"Open-source observability & evaluation platform for AI agents and coding agents","github_url":"https://github.com/openlit/openlit","owner":"openlit","repo":"openlit","owner_avatar_url":"https://avatars.githubusercontent.com/u/149867240?v=4","primary_language":"TypeScript","stars":2770,"forks":390,"topics":["ai-engineering","ai-evaluation","ai-observability","ai-observability-platform","amd-gpu","claude-code","clickhouse","codex","coding-agent","coding-agents","cursor","genai","gpu-monitoring","llm-observability","llmops","nvidia-smi","observability","open-source","openai","opentelemetry"],"archived":false,"github_pushed_at":"2026-09-17T21:59:22+00:00","maintenance_label":"Very active","stars_delta_30d":106,"url":"https://www.graphcanon.com/tools/openlit-openlit","markdown_url":"https://www.graphcanon.com/tools/openlit-openlit.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/openlit-openlit","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=openlit-openlit"},"categories":[{"slug":"evaluation-observability","name":"Evaluation & Observability","url":"https://www.graphcanon.com/categories/evaluation-observability","markdown_url":"https://www.graphcanon.com/categories/evaluation-observability.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/evaluation-observability"}],"tags":[{"slug":"ai-engineering","name":"ai-engineering"},{"slug":"ai-evaluation","name":"ai-evaluation"},{"slug":"ai-observability","name":"ai-observability"},{"slug":"ai-observability-platform","name":"ai-observability-platform"},{"slug":"amd-gpu","name":"amd-gpu"},{"slug":"claude-code","name":"claude-code"},{"slug":"clickhouse","name":"clickhouse"},{"slug":"codex","name":"codex"}],"edges":[{"type":"integrates_with","direction":"out","explanation":"OpenLIT focuses on observability, monitoring, and managing AI tools like LLMs, which aligns with LangFlow’s aim to build and deploy AI agents and workflows.","successor_context":null,"tool":{"slug":"langflow-ai-langflow","name":"langflow","tagline":"A tool for building and deploying AI-powered agents and workflows","github_url":"https://github.com/langflow-ai/langflow","owner":"langflow-ai","repo":"langflow","owner_avatar_url":"https://avatars.githubusercontent.com/u/85702467?v=4","primary_language":"Python","stars":154963,"forks":10109,"topics":["agents","chatgpt","generative-ai","large-language-models","multiagent","react-flow"],"archived":false,"github_pushed_at":"2026-09-18T02:17:58+00:00","maintenance_label":"Very active","stars_delta_30d":2219,"url":"https://www.graphcanon.com/tools/langflow-ai-langflow","markdown_url":"https://www.graphcanon.com/tools/langflow-ai-langflow.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/langflow-ai-langflow","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=langflow-ai-langflow"}},{"type":"integrates_with","direction":"out","explanation":"Both OpenLIT and LangChain-Chatchat are centered around managing LLMs, including observability and workflows, suggesting they can integrate for enhanced AI application management.","successor_context":null,"tool":{"slug":"chatchat-space-langchain-chatchat","name":"Langchain-Chatchat","tagline":"Local knowledge-based LLM RAG and Agent app with Langchain","github_url":"https://github.com/chatchat-space/Langchain-Chatchat","owner":"chatchat-space","repo":"Langchain-Chatchat","owner_avatar_url":"https://avatars.githubusercontent.com/u/139558948?v=4","primary_language":"Python","stars":38644,"forks":6265,"topics":["chatbot","chatchat","chatglm","chatgpt","embedding","faiss","fastchat","gpt","knowledge-base","langchain","langchain-chatglm","llama","llm","milvus","ollama","qwen","rag","retrieval-augmented-generation","streamlit","xinference"],"archived":false,"github_pushed_at":"2025-11-10T09:27:42+00:00","maintenance_label":"Slowing","stars_delta_30d":122,"url":"https://www.graphcanon.com/tools/chatchat-space-langchain-chatchat","markdown_url":"https://www.graphcanon.com/tools/chatchat-space-langchain-chatchat.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/chatchat-space-langchain-chatchat","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=chatchat-space-langchain-chatchat"}},{"type":"related","direction":"in","explanation":"PandasAI and OpenLit both deal with enhancing the observability and monitoring of AI engineering systems but approach this goal from different angles.","successor_context":null,"tool":{"slug":"sinaptik-ai-pandas-ai","name":"pandas-ai","tagline":"Chat with your database or your datalake using LLMs and RAG.","github_url":"https://github.com/sinaptik-ai/pandas-ai","owner":"sinaptik-ai","repo":"pandas-ai","owner_avatar_url":"https://avatars.githubusercontent.com/u/154438448?v=4","primary_language":"Python","stars":23746,"forks":2342,"topics":["ai","csv","data","data-analysis","data-science","data-visualization","database","datalake","gpt-4","llm","pandas","sql","text-to-sql"],"archived":false,"github_pushed_at":"2025-10-28T10:02:13+00:00","maintenance_label":"Slowing","stars_delta_30d":90,"url":"https://www.graphcanon.com/tools/sinaptik-ai-pandas-ai","markdown_url":"https://www.graphcanon.com/tools/sinaptik-ai-pandas-ai.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/sinaptik-ai-pandas-ai","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=sinaptik-ai-pandas-ai"}},{"type":"related","direction":"in","explanation":"Both platforms are concerned with observability for AI and LLM applications.","successor_context":null,"tool":{"slug":"agenta-ai-agenta","name":"agenta","tagline":"A workspace for building and orchestrating AI agents and automations.","github_url":"https://github.com/Agenta-AI/agenta","owner":"Agenta-AI","repo":"agenta","owner_avatar_url":"https://avatars.githubusercontent.com/u/127993667?v=4","primary_language":"TypeScript","stars":4764,"forks":673,"topics":["agent-builder","agent-observability","agent-orchestration","agent-workspace","agentic-ai","ai-agent","ai-agents","ai-automation","ai-coworker","ai-skills-manager","ai-workflow-builder","harness","mcp","open-source","self-hosted","workflow-automation"],"archived":false,"github_pushed_at":"2026-09-18T06:32:52+00:00","maintenance_label":"Very active","stars_delta_30d":319,"url":"https://www.graphcanon.com/tools/agenta-ai-agenta","markdown_url":"https://www.graphcanon.com/tools/agenta-ai-agenta.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/agenta-ai-agenta","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=agenta-ai-agenta"}},{"type":"related","direction":"in","explanation":"Both focus on observability and building/evaluating AI-driven applications.","successor_context":null,"tool":{"slug":"trycua-cua","name":"cua","tagline":"Open-source infrastructure for Computer-Use Agents","github_url":"https://github.com/trycua/cua","owner":"trycua","repo":"cua","owner_avatar_url":"https://avatars.githubusercontent.com/u/191107687?v=4","primary_language":"HTML","stars":21516,"forks":1479,"topics":["agent","ai-agent","apple","computer-use","computer-use-agent","containerization","cua","desktop-automation","hacktoberfest","lume","macos","manus","operator","swift","virtualization","virtualization-framework","windows","windows-sandbox"],"archived":false,"github_pushed_at":"2026-08-19T00:25:37+00:00","maintenance_label":"Very active","stars_delta_30d":1361,"url":"https://www.graphcanon.com/tools/trycua-cua","markdown_url":"https://www.graphcanon.com/tools/trycua-cua.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/trycua-cua","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=trycua-cua"}},{"type":"related","direction":"in","explanation":"OpenLit provides observability tools that might be used to evaluate systems like R2R; both are involved in the broader space of AI engineering infrastructure and evaluation.","successor_context":null,"tool":{"slug":"sciphi-ai-r2r","name":"R2R","tagline":"SoTA production-ready AI retrieval system with RESTful API","github_url":"https://github.com/SciPhi-AI/R2R","owner":"SciPhi-AI","repo":"R2R","owner_avatar_url":"https://avatars.githubusercontent.com/u/148402514?v=4","primary_language":"Python","stars":7999,"forks":647,"topics":["artificial-intelligence","large-language-models","python","question-answering","rag","retrieval-augmented-generation","retrieval-systems","search"],"archived":false,"github_pushed_at":"2025-11-07T01:02:44+00:00","maintenance_label":"Slowing","stars_delta_30d":32,"url":"https://www.graphcanon.com/tools/sciphi-ai-r2r","markdown_url":"https://www.graphcanon.com/tools/sciphi-ai-r2r.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/sciphi-ai-r2r","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=sciphi-ai-r2r"}},{"type":"alternative","direction":"in","explanation":"Openlit and Evidently both focus on observability in AI engineering, representing alternatives to each other.","successor_context":null,"tool":{"slug":"evidentlyai-evidently","name":"evidently","tagline":"An open-source ML and LLM observability framework for evaluating, testing, and monitoring AI systems and data pipelines.","github_url":"https://github.com/evidentlyai/evidently","owner":"evidentlyai","repo":"evidently","owner_avatar_url":"https://avatars.githubusercontent.com/u/75031056?v=4","primary_language":"Jupyter Notebook","stars":7924,"forks":919,"topics":["data-drift","data-quality","data-science","data-validation","generative-ai","hacktoberfest","html-report","jupyter-notebook","llm","llmops","machine-learning","mlops","model-monitoring","pandas-dataframe"],"archived":false,"github_pushed_at":"2026-09-11T09:03:28+00:00","maintenance_label":"Very active","stars_delta_30d":134,"url":"https://www.graphcanon.com/tools/evidentlyai-evidently","markdown_url":"https://www.graphcanon.com/tools/evidentlyai-evidently.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/evidentlyai-evidently","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=evidentlyai-evidently"}},{"type":"integrates_with","direction":"in","explanation":"Openlit is designed to enhance observability in the development of AI applications, which can complement Plano’s own observability features for a complete monitoring solution when building and deploying agents.","successor_context":null,"tool":{"slug":"katanemo-plano","name":"plano","tagline":"An AI-native proxy and data plane for agentic apps","github_url":"https://github.com/katanemo/plano","owner":"katanemo","repo":"plano","owner_avatar_url":"https://avatars.githubusercontent.com/u/112724757?v=4","primary_language":"Rust","stars":7058,"forks":483,"topics":["ai-gateway","ai-gateway-support","envoy","envoyproxy","gateway","generative-ai","llm-gateway","llm-inference","llm-proxy","llm-routing","llmops","llms","openai","prompt","proxy","proxy-server","routing"],"archived":false,"github_pushed_at":"2026-08-19T19:29:08+00:00","maintenance_label":"Steady","stars_delta_30d":54,"url":"https://www.graphcanon.com/tools/katanemo-plano","markdown_url":"https://www.graphcanon.com/tools/katanemo-plano.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/katanemo-plano","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=katanemo-plano"}},{"type":"alternative","direction":"in","explanation":"OpenLit shares a similar focus on AI engineering observability but is more focused on providing a platform with diverse functionalities whereas TruLens specializes in detailed evaluation and monitoring.","successor_context":null,"tool":{"slug":"truera-trulens","name":"trulens","tagline":"Evaluation and Tracking for LLM Experiments and AI Agents","github_url":"https://github.com/truera/trulens","owner":"truera","repo":"trulens","owner_avatar_url":"https://avatars.githubusercontent.com/u/51224128?v=4","primary_language":"Python","stars":3563,"forks":345,"topics":["agent-evaluation","agentops","ai-agents","ai-monitoring","ai-observability","evals","explainable-ml","llm-eval","llm-evaluation","llmops","llms","machine-learning","neural-networks"],"archived":false,"github_pushed_at":"2026-09-18T08:44:06+00:00","maintenance_label":"Very active","stars_delta_30d":47,"url":"https://www.graphcanon.com/tools/truera-trulens","markdown_url":"https://www.graphcanon.com/tools/truera-trulens.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/truera-trulens","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=truera-trulens"}},{"type":"integrates_with","direction":"in","explanation":"Paddler's focus on monitoring and observability metrics aligns well with OpenLit, a platform aimed at AI engineering observability. This integration can provide comprehensive monitoring and analysis of LLM serving performance.","successor_context":null,"tool":{"slug":"intentee-paddler","name":"paddler","tagline":"Open-source LLM/VLM load balancer and serving platform for self-hosting at scale","github_url":"https://github.com/intentee/paddler","owner":"intentee","repo":"paddler","owner_avatar_url":"https://avatars.githubusercontent.com/u/215040511?v=4","primary_language":"Rust","stars":1674,"forks":98,"topics":["ai","llamacpp","llm","llmops","load-balancer"],"archived":false,"github_pushed_at":"2026-09-17T17:41:40+00:00","maintenance_label":"Very active","stars_delta_30d":11,"url":"https://www.graphcanon.com/tools/intentee-paddler","markdown_url":"https://www.graphcanon.com/tools/intentee-paddler.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/intentee-paddler","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=intentee-paddler"}},{"type":"integrates_with","direction":"in","explanation":"Openlit offers a platform for AI Engineering Observability which could work in conjunction with LLMFlows to monitor and evaluate the performance of large language model applications.","successor_context":null,"tool":{"slug":"stoyan-stoyanov-llmflows","name":"llmflows","tagline":"Simple, Explicit and Transparent LLM Apps","github_url":"https://github.com/stoyan-stoyanov/llmflows","owner":"stoyan-stoyanov","repo":"llmflows","owner_avatar_url":"https://avatars.githubusercontent.com/u/14061867?v=4","primary_language":"Python","stars":708,"forks":35,"topics":["ai","chatgpt","gpt-4","llm","llm-inference","llmops","llms","machine-learning","openai","prompt-engineering","python","question-answering","vector-database"],"archived":false,"github_pushed_at":"2025-02-20T16:53:45+00:00","maintenance_label":"Dormant","stars_delta_30d":1,"url":"https://www.graphcanon.com/tools/stoyan-stoyanov-llmflows","markdown_url":"https://www.graphcanon.com/tools/stoyan-stoyanov-llmflows.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/stoyan-stoyanov-llmflows","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=stoyan-stoyanov-llmflows"}},{"type":"integrates_with","direction":"in","explanation":"`Vigil`, as an observability tool for detecting LLM threats, could integrate with `Openlit` to improve the observability and security practices in AI engineering.","successor_context":null,"tool":{"slug":"deadbits-vigil-llm","name":"vigil-llm","tagline":"Detect prompt injections and other risky inputs in LLMs","github_url":"https://github.com/deadbits/vigil-llm","owner":"deadbits","repo":"vigil-llm","owner_avatar_url":"https://avatars.githubusercontent.com/u/1332757?v=4","primary_language":"Python","stars":496,"forks":56,"topics":["adversarial-attacks","adversarial-machine-learning","large-language-models","llm-security","llmops","prompt-injection","security-tools","yara-scanner"],"archived":false,"github_pushed_at":"2024-01-31T18:43:41+00:00","maintenance_label":"Dormant","stars_delta_30d":5,"url":"https://www.graphcanon.com/tools/deadbits-vigil-llm","markdown_url":"https://www.graphcanon.com/tools/deadbits-vigil-llm.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/deadbits-vigil-llm","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=deadbits-vigil-llm"}},{"type":"related","direction":"in","explanation":"Given the emphasis on AI engineering observability by OpenLIT and general LLMOps tools curated in 'Awesome-LLMOps', they are tangentially related.","successor_context":null,"tool":{"slug":"tensorchord-awesome-llmops","name":"Awesome-LLMOps","tagline":"An awesome & curated list of best LLMOps tools for developers","github_url":"https://github.com/tensorchord/Awesome-LLMOps","owner":"tensorchord","repo":"Awesome-LLMOps","owner_avatar_url":"https://avatars.githubusercontent.com/u/100543303?v=4","primary_language":"Shell","stars":5941,"forks":1058,"topics":["ai-development-tools","awesome-list","llmops","mlops"],"archived":false,"github_pushed_at":"2026-05-21T09:12:50+00:00","maintenance_label":"Slowing","stars_delta_30d":26,"url":"https://www.graphcanon.com/tools/tensorchord-awesome-llmops","markdown_url":"https://www.graphcanon.com/tools/tensorchord-awesome-llmops.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/tensorchord-awesome-llmops","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=tensorchord-awesome-llmops"}}],"neighbours":[{"slug":"langfuse-langfuse","name":"langfuse","tagline":"Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.","github_url":"https://github.com/langfuse/langfuse","owner":"langfuse","repo":"langfuse","owner_avatar_url":"https://avatars.githubusercontent.com/u/134601687?v=4","primary_language":"TypeScript","stars":34763,"forks":3793,"topics":["analytics","autogen","evaluation","langchain","large-language-models","llama-index","llm","llm-evaluation","llm-observability","llmops","monitoring","observability","open-source","openai","playground","prompt-engineering","prompt-management","self-hosted","ycombinator"],"archived":false,"github_pushed_at":"2026-09-18T08:08:19+00:00","maintenance_label":"Active","url":"https://www.graphcanon.com/tools/langfuse-langfuse","markdown_url":"https://www.graphcanon.com/tools/langfuse-langfuse.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/langfuse-langfuse","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=langfuse-langfuse","shared_categories":["evaluation-observability"]},{"slug":"comet-ml-opik","name":"opik","tagline":"Debug, evaluate, and monitor LLM applications, RAG systems, and agentic workflows","github_url":"https://github.com/comet-ml/opik","owner":"comet-ml","repo":"opik","owner_avatar_url":"https://avatars.githubusercontent.com/u/31487821?v=4","primary_language":"Python","stars":22110,"forks":1801,"topics":["evaluation","hacktoberfest","hacktoberfest2025","langchain","llama-index","llm","llm-evaluation","llm-observability","llmops","open-source","openai","playground","prompt-engineering"],"archived":false,"github_pushed_at":"2026-09-18T08:25:51+00:00","maintenance_label":"Active","url":"https://www.graphcanon.com/tools/comet-ml-opik","markdown_url":"https://www.graphcanon.com/tools/comet-ml-opik.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/comet-ml-opik","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=comet-ml-opik","shared_categories":["evaluation-observability"]},{"slug":"raga-ai-hub-ragaai-catalyst","name":"RagaAI-Catalyst","tagline":"Python SDK for AI agent observability and evaluation","github_url":"https://github.com/raga-ai-hub/RagaAI-Catalyst","owner":"raga-ai-hub","repo":"RagaAI-Catalyst","owner_avatar_url":"https://avatars.githubusercontent.com/u/161833182?v=4","primary_language":"Python","stars":16162,"forks":3567,"topics":["agentic-ai","agentic-ai-development","agentneo","agents","ai-agent-monitoring","ai-application-debugging","ai-evaluation-tools","ai-performance-optimization","ai-tool-interaction-monitoring","llm-testing","llm-tracing","llmops"],"archived":false,"github_pushed_at":"2026-02-11T14:43:33+00:00","maintenance_label":"Slowing","url":"https://www.graphcanon.com/tools/raga-ai-hub-ragaai-catalyst","markdown_url":"https://www.graphcanon.com/tools/raga-ai-hub-ragaai-catalyst.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/raga-ai-hub-ragaai-catalyst","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=raga-ai-hub-ragaai-catalyst","shared_categories":["evaluation-observability"]},{"slug":"lightning-ai-litgpt","name":"litgpt","tagline":"High-performance LLMs for pretraining, finetuning, and deployment","github_url":"https://github.com/Lightning-AI/litgpt","owner":"Lightning-AI","repo":"litgpt","owner_avatar_url":"https://avatars.githubusercontent.com/u/58386951?v=4","primary_language":"Python","stars":13667,"forks":1503,"topics":["ai","artificial-intelligence","deep-learning","large-language-models","llm","llm-inference","llms"],"archived":false,"github_pushed_at":"2026-09-14T10:24:06+00:00","maintenance_label":"Active","url":"https://www.graphcanon.com/tools/lightning-ai-litgpt","markdown_url":"https://www.graphcanon.com/tools/lightning-ai-litgpt.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/lightning-ai-litgpt","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=lightning-ai-litgpt","shared_categories":[]},{"slug":"traceloop-openllmetry","name":"openllmetry","tagline":"Open-source observability for GenAI or LLM applications based on OpenTelemetry","github_url":"https://github.com/traceloop/openllmetry","owner":"traceloop","repo":"openllmetry","owner_avatar_url":"https://avatars.githubusercontent.com/u/125419530?v=4","primary_language":"Python","stars":7438,"forks":1082,"topics":["artifical-intelligence","datascience","generative-ai","good-first-issue","good-first-issues","help-wanted","llm","llmops","metrics","ml","model-monitoring","monitoring","observability","open-source","open-telemetry","opentelemetry","opentelemetry-python","python"],"archived":false,"github_pushed_at":"2026-09-17T18:54:33+00:00","maintenance_label":"Active","url":"https://www.graphcanon.com/tools/traceloop-openllmetry","markdown_url":"https://www.graphcanon.com/tools/traceloop-openllmetry.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/traceloop-openllmetry","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=traceloop-openllmetry","shared_categories":["evaluation-observability"]},{"slug":"tensorchord-awesome-llmops","name":"Awesome-LLMOps","tagline":"An awesome & curated list of best LLMOps tools for developers","github_url":"https://github.com/tensorchord/Awesome-LLMOps","owner":"tensorchord","repo":"Awesome-LLMOps","owner_avatar_url":"https://avatars.githubusercontent.com/u/100543303?v=4","primary_language":"Shell","stars":5941,"forks":1058,"topics":["ai-development-tools","awesome-list","llmops","mlops"],"archived":false,"github_pushed_at":"2026-05-21T09:12:50+00:00","maintenance_label":"Slowing","url":"https://www.graphcanon.com/tools/tensorchord-awesome-llmops","markdown_url":"https://www.graphcanon.com/tools/tensorchord-awesome-llmops.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/tensorchord-awesome-llmops","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=tensorchord-awesome-llmops","shared_categories":["evaluation-observability"]},{"slug":"agentops-ai-agentops","name":"agentops","tagline":"Python SDK for AI agent monitoring and LLM cost tracking","github_url":"https://github.com/AgentOps-AI/agentops","owner":"AgentOps-AI","repo":"agentops","owner_avatar_url":"https://avatars.githubusercontent.com/u/140554352?v=4","primary_language":"Python","stars":5830,"forks":625,"topics":["agent","agentops","agents-sdk","ai","anthropic","autogen","cost-estimation","crewai","evals","evaluation-metrics","groq","langchain","llm","mistral","ollama","openai","openai-agents"],"archived":false,"github_pushed_at":"2026-06-25T08:25:03+00:00","maintenance_label":"Slowing","url":"https://www.graphcanon.com/tools/agentops-ai-agentops","markdown_url":"https://www.graphcanon.com/tools/agentops-ai-agentops.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/agentops-ai-agentops","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=agentops-ai-agentops","shared_categories":["evaluation-observability"]},{"slug":"langwatch-langwatch","name":"langwatch","tagline":"The platform for LLM evaluations and AI agent testing","github_url":"https://github.com/langwatch/langwatch","owner":"langwatch","repo":"langwatch","owner_avatar_url":"https://avatars.githubusercontent.com/u/146763322?v=4","primary_language":"TypeScript","stars":4814,"forks":393,"topics":["agent-testing","ai","analytics","datasets","dspy","evaluation","gpt","llm","llm-ops","llmops","low-code","observability","observability-platform","openai","prompt-engineering","simulation-testing"],"archived":false,"github_pushed_at":"2026-09-18T08:04:08+00:00","maintenance_label":"Active","url":"https://www.graphcanon.com/tools/langwatch-langwatch","markdown_url":"https://www.graphcanon.com/tools/langwatch-langwatch.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/langwatch-langwatch","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=langwatch-langwatch","shared_categories":["evaluation-observability"]},{"slug":"pezzolabs-pezzo","name":"pezzo","tagline":"Open-source, developer-first LLMOps platform","github_url":"https://github.com/pezzolabs/pezzo","owner":"pezzolabs","repo":"pezzo","owner_avatar_url":"https://avatars.githubusercontent.com/u/119122072?v=4","primary_language":"TypeScript","stars":3273,"forks":279,"topics":["ai","devtools","gpt-3","gpt-4","hacktoberfest","javascript","langchain","llm","llmops","monitoring","nestjs","nodejs","observability","openai","platform","prompt","prompt-engineering","prompt-management","python","typescript"],"archived":false,"github_pushed_at":"2026-08-21T21:40:31+00:00","maintenance_label":"Steady","url":"https://www.graphcanon.com/tools/pezzolabs-pezzo","markdown_url":"https://www.graphcanon.com/tools/pezzolabs-pezzo.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/pezzolabs-pezzo","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=pezzolabs-pezzo","shared_categories":["evaluation-observability"]},{"slug":"huggingface-lighteval","name":"lighteval","tagline":"All-in-one toolkit for evaluating LLMs across multiple backends","github_url":"https://github.com/huggingface/lighteval","owner":"huggingface","repo":"lighteval","owner_avatar_url":"https://avatars.githubusercontent.com/u/25720743?v=4","primary_language":"Python","stars":2554,"forks":576,"topics":["evaluation","evaluation-framework","evaluation-metrics","huggingface"],"archived":false,"github_pushed_at":"2026-10-06T09:36:52+00:00","maintenance_label":"Very active","url":"https://www.graphcanon.com/tools/huggingface-lighteval","markdown_url":"https://www.graphcanon.com/tools/huggingface-lighteval.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/huggingface-lighteval","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=huggingface-lighteval","shared_categories":["evaluation-observability"]},{"slug":"future-agi-future-agi","name":"future-agi","tagline":"Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications","github_url":"https://github.com/future-agi/future-agi","owner":"future-agi","repo":"future-agi","owner_avatar_url":"https://avatars.githubusercontent.com/u/147392366?v=4","primary_language":"Python","stars":2032,"forks":627,"topics":["ai-agents","ai-evals","ai-gateway","ai-optimization","ai-simulations","evaluation-framework","guardrails","hallucination-detection","llm","llm-evaluation","llm-observability","llmops","model-evaluation","observability","opentelemetry","rag","rag-evaluation","simulation","telemetry","tracing"],"archived":false,"github_pushed_at":"2026-09-18T08:15:25+00:00","maintenance_label":"Active","url":"https://www.graphcanon.com/tools/future-agi-future-agi","markdown_url":"https://www.graphcanon.com/tools/future-agi-future-agi.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/future-agi-future-agi","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=future-agi-future-agi","shared_categories":["evaluation-observability"]},{"slug":"scale3-labs-langtrace","name":"langtrace","tagline":"Open Telemetry based observability tool for LLM applications","github_url":"https://github.com/Scale3-Labs/langtrace","owner":"Scale3-Labs","repo":"langtrace","owner_avatar_url":"https://avatars.githubusercontent.com/u/110545750?v=4","primary_language":"TypeScript","stars":1232,"forks":127,"topics":["ai","datasets","evaluations","gpt","langchain","llm","llm-framework","llmops","observability","open-source","open-telemetry","openai","prompt-engineering","tracing"],"archived":false,"github_pushed_at":"2025-11-17T15:08:48+00:00","maintenance_label":"Slowing","url":"https://www.graphcanon.com/tools/scale3-labs-langtrace","markdown_url":"https://www.graphcanon.com/tools/scale3-labs-langtrace.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/scale3-labs-langtrace","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=scale3-labs-langtrace","shared_categories":["evaluation-observability"]}]}}