{"data":{"slug":"openlit-openlit","name":"openlit","tagline":"A comprehensive open-source platform for AI Engineering with LLM Observability, Monitoring, and Management","github_url":"https://github.com/openlit/openlit","owner":"openlit","repo":"openlit","owner_avatar_url":"https://avatars.githubusercontent.com/u/149867240?v=4","primary_language":"TypeScript","stars":2664,"forks":342,"topics":["ai-observability","amd-gpu","clickhouse","distributed-tracing","genai","gpu-monitoring","grafana","langchain","llmops","llms","metrics","monitoring-tool","nvidia-smi","observability","open-source","openai","opentelemetry","otlp","python","tracing"],"archived":false,"github_pushed_at":"2026-07-31T18:39:37+00:00","maintenance_label":"Very active","url":"https://www.graphcanon.com/tools/openlit-openlit","markdown_url":"https://www.graphcanon.com/tools/openlit-openlit.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/openlit-openlit","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=openlit-openlit","description":"Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs.","homepage_url":"https://docs.openlit.io","license":"Apache-2.0","open_issues":48,"watchers":19,"ai_summary":"Integrates with multiple LLM Providers, Vector Databases, Agents, GPUs; supports observability and monitoring tools.","readme_excerpt":"## 🚀 Getting Started with LLM Observability\n\n```mermaid\nflowchart TB;\n    subgraph \" \"\n        direction LR;\n        subgraph \" \"\n            direction LR;\n            OpenLIT_SDK[OpenLIT SDK] -->|Sends Traces & Metrics| OTC[OpenTelemetry Collector];\n            OTC -->|Stores Data| ClickHouseDB[ClickHouse];\n        end\n        subgraph \" \"\n            direction RL;\n            OpenLIT_UI[OpenLIT] -->|Pulls Data| ClickHouseDB;\n        end\n    end\n```\n\n---\n\n### Step 2: Install OpenLIT SDK\n\nOpen your command line or terminal and run:\n\n```bash\npip install openlit\n```\n\n> For instructions on using the TypeScript SDK, visit the [TypeScript SDK Installation guide](https://github.com/openlit/openlit/tree/main/sdk/typescript#-installation).\n\n---\n\n## License\n\nOpenLIT is available under the [Apache-2.0 license](LICENSE).","github_created_at":"2024-01-23T17:40:59+00:00","created_at":"2026-07-07T17:42:29.780651+00:00","updated_at":"2026-08-01T12:00:12.515265+00:00","categories":[{"slug":"evaluation-observability","name":"Evaluation & Observability","url":"https://www.graphcanon.com/categories/evaluation-observability","markdown_url":"https://www.graphcanon.com/categories/evaluation-observability.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/evaluation-observability"},{"slug":"inference-serving","name":"Inference & Serving","url":"https://www.graphcanon.com/categories/inference-serving","markdown_url":"https://www.graphcanon.com/categories/inference-serving.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/inference-serving"}],"tags":[{"slug":"ai-observability","name":"ai-observability"},{"slug":"gpu-monitoring","name":"gpu-monitoring"},{"slug":"langchain","name":"langchain"},{"slug":"llmops","name":"llmops"},{"slug":"monitoring-tool","name":"monitoring-tool"},{"slug":"opentelemetry","name":"opentelemetry"}],"trust":{"provenance":{"is_fork":false,"github_id":747319327,"owner_type":"Organization","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-08-01T12:00:11.648Z","maintenance":{"label":"Very active","score":96,"methodology":"github_public_v1","releases_90d":20,"days_since_push":0,"last_release_at":"2026-07-28T20:01:37Z"},"security_summary":{"status":"no_lockfile","scanner":null,"low_count":0,"high_count":0,"last_scan_at":"2026-07-11T10:29:26.061Z","medium_count":0,"scan_profile":"none","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-08-01T12:00:12.131Z"},"deploy":{"source":"dockerfile:docker-compose.yml","self_host":true,"observed_at":"2026-08-01T12:00:12.131Z","managed_saas":false},"languages":{"value":["typescript"],"source":"github.language","observed_at":"2026-08-01T12:00:12.131Z"},"has_docker":{"value":true,"source":"dockerfile:docker-compose.yml","observed_at":"2026-08-01T12:00:12.131Z"},"license_spdx":{"value":"Apache-2.0","source":"github.license","observed_at":"2026-08-01T12:00:12.131Z"}},"decision_facts":{"hosting":null,"pricing":{"model":"freemium"},"requirements":{},"constraints":{"pricing_model":"freemium"},"when_to_use":["When you need comprehensive observability features native to OpenTelemetry, allowing seamless trace and metric management with an out-of-the-box solution.","If your project involves multiple GPUs or diverse vector databases (50+ integrations), leveraging OpenLIT for unified GPU monitoring and resource management can be highly advantageous.","For AI engineering environments requiring robust prompt management, evaluation tools, and security guardrails to ensure compliance across different LLM providers."],"when_not_to_use":["If your project strictly requires a proprietary tool or if you have specific requirements that are not covered by OpenLIT's integrations, such as unique vector databases not yet supported.","When the team lacks the expertise in TypeScript or Python SDK to efficiently manage and implement observability into their current workflows with OpenLIT."],"source":"enrich:decision_facts","observed_at":"2026-07-11T11:15:11.356Z"},"constraint_facets":{"pricing_model":"freemium"},"decision_summary":[{"label":"Pricing","value":"freemium"},{"label":"Adopt for","value":"Decision-critical facts for OpenLIT are centered around its unique features in LLM observability, GPU monitoring, and extensive integration capabilities."},{"label":"License detail","value":"Apache-2.0"}]}}