{"data":{"slug":"truera-trulens","name":"trulens","tagline":"Evaluation and Tracking for LLM Experiments and AI Agents","github_url":"https://github.com/truera/trulens","owner":"truera","repo":"trulens","owner_avatar_url":"https://avatars.githubusercontent.com/u/51224128?v=4","primary_language":"Python","stars":3516,"forks":327,"topics":["agent-evaluation","agentops","ai-agents","ai-monitoring","ai-observability","evals","explainable-ml","llm-eval","llm-evaluation","llmops","llms","machine-learning","neural-networks"],"archived":false,"github_pushed_at":"2026-08-20T10:21:00+00:00","maintenance_label":"Very active","stars_delta_30d":68,"url":"https://www.graphcanon.com/tools/truera-trulens","markdown_url":"https://www.graphcanon.com/tools/truera-trulens.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/truera-trulens","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=truera-trulens","description":"Evaluation and Tracking for LLM Experiments and AI Agents","homepage_url":"https://www.trulens.org/","license":"MIT","open_issues":65,"watchers":23,"ai_summary":"Trulens is a toolset dedicated to evaluating and monitoring the performance of Language Model experiments and AI agents. It provides functionalities for comprehensive evaluation, aiding in explainable machine learning (ML) through various integrations with different model providers.","readme_excerpt":"## Installation and Setup\n\nInstall the trulens pip package from PyPI.\n\n```bash\npip install trulens\n```\n\nInstall with a specific LLM provider for feedback evaluation:\n\n```bash\npip install trulens trulens-providers-openai   # OpenAI / Azure OpenAI\npip install trulens trulens-providers-litellm  # LiteLLM (Anthropic, Cohere, Mistral, …)\npip install trulens trulens-providers-google   # Google Gemini\npip install trulens trulens-providers-bedrock  # AWS Bedrock\npip install trulens trulens-providers-cortex   # Snowflake Cortex\npip install trulens trulens-providers-huggingface  # HuggingFace\npip install trulens trulens-providers-langchain    # LangChain models\n```\n\nInstall with a specific app framework integration:\n\n```bash\npip install trulens trulens-apps-langchain    # LangChain / LangGraph\npip install trulens trulens-apps-llamaindex  # LlamaIndex\n```","github_created_at":"2020-11-02T21:56:45+00:00","created_at":"2026-07-07T17:42:18.177683+00:00","updated_at":"2026-08-20T12:01:59.387751+00:00","categories":[{"slug":"ai-agents","name":"AI Agents","url":"https://www.graphcanon.com/categories/ai-agents","markdown_url":"https://www.graphcanon.com/categories/ai-agents.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/ai-agents"},{"slug":"evaluation-observability","name":"Evaluation & Observability","url":"https://www.graphcanon.com/categories/evaluation-observability","markdown_url":"https://www.graphcanon.com/categories/evaluation-observability.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/evaluation-observability"}],"tags":[{"slug":"agent-evaluation","name":"agent-evaluation"},{"slug":"ai-agents","name":"ai-agents"},{"slug":"ai-monitoring","name":"ai-monitoring"},{"slug":"evaluation-tool","name":"evaluation-tool"},{"slug":"llm-eval","name":"llm-eval"},{"slug":"observability","name":"observability"}],"trust":{"provenance":{"is_fork":false,"github_id":309504885,"owner_type":"Organization","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-08-20T12:01:58.565Z","maintenance":{"label":"Very active","score":96,"methodology":"github_public_v1","releases_90d":4,"days_since_push":0,"last_release_at":"2026-08-06T20:52:26Z","stars_delta_30d":68,"open_issues_delta_30d":-32},"security_summary":{"status":"ok","scanner":"osv@v1","low_count":0,"high_count":0,"last_scan_at":"2026-07-11T11:20:39.357Z","medium_count":0,"scan_profile":"deps","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-08-20T12:01:59.049Z"},"languages":{"value":["python"],"source":"github.language+pyproject.toml","observed_at":"2026-08-20T12:01:59.049Z"},"license_spdx":{"value":"MIT","source":"github.license","observed_at":"2026-08-20T12:01:59.049Z"}},"decision_facts":{"hosting":null,"pricing":null,"requirements":null,"constraints":null,"when_to_use":["Need to evaluate specific models from OpenAI, Google Gemini, AWS Bedrock, or HuggingFace.","Focus on explainable machine learning through comprehensive evaluations.","Work within frameworks like LangChain, LangGraph, or LlamaIndex."],"when_not_to_use":["Looking for a tool that solely focuses on training models rather than evaluation and monitoring.","Require support for less common model providers not listed in Trulens integrations."],"source":"enrich:decision_facts","observed_at":"2026-07-12T11:31:42.536Z"},"constraint_facets":null,"decision_summary":[{"label":"Adopt for","value":"Trulens aids in evaluating and monitoring Language Model experiments and AI agents, with integrations for various providers."}]}}