{"data":{"slug":"berriai-litellm","name":"litellm","tagline":"Python SDK and Proxy Server for calling multiple LLM APIs","github_url":"https://github.com/BerriAI/litellm","owner":"BerriAI","repo":"litellm","owner_avatar_url":"https://avatars.githubusercontent.com/u/121462774?v=4","primary_language":"Python","stars":55221,"forks":10231,"topics":["ai-gateway","anthropic","azure-openai","bedrock","gateway","langchain","litellm","llm","llm-gateway","llmops","mcp-gateway","openai","openai-proxy","rust","rust-ai","vertex-ai"],"archived":false,"github_pushed_at":"2026-08-01T05:53:28+00:00","maintenance_label":"Very active","url":"https://www.graphcanon.com/tools/berriai-litellm","markdown_url":"https://www.graphcanon.com/tools/berriai-litellm.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/berriai-litellm","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=berriai-litellm","description":"The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]","homepage_url":"https://docs.litellm.ai/docs/","license":"Other","open_issues":4634,"watchers":219,"ai_summary":"Provides an AI gateway to interact with over 100 LLM APIs, including cost tracking, guardrails, load balancing, and logging.","readme_excerpt":"### Verify Docker Image Signatures\n\nAll LiteLLM Docker images published to GHCR are signed with [cosign](https://docs.sigstore.dev/cosign/overview/). Every release is signed with the same key introduced in [commit `0112e53`](https://github.com/BerriAI/litellm/commit/0112e53046018d726492c814b3644b7d376029d0).\n\n**Verify using the pinned commit hash (recommended):**\n\nA commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key:\n\n```bash\ncosign verify \\\n  --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \\\n  ghcr.io/berriai/litellm:<release-tag>\n```\n\n**Verify using a release tag (convenience):**\n\nTags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:\n\n```bash\ncosign verify \\\n  --key https://raw.githubusercontent.com/BerriAI/litellm/<release-tag>/cosign.pub \\\n  ghcr.io/berriai/litellm:<release-tag>\n```\n\nReplace `<release-tag>` with the version you are deploying (e.g. `v1.83.0-stable`).\n\n---\n\n---\n\n## Quick Start for Contributors\n\nThis requires uv to be installed.\n\n```bash\ngit clone https://github.com/BerriAI/litellm.git\ncd litellm\nmake install-dev    # Install development dependencies\nmake format         # Format your code\nmake lint           # Run all linting checks\nmake test-unit      # Run unit tests\nmake format-check   # Check formatting only\n```\n\nFor detailed contributing guidelines, see [CONTRIBUTING.md](CONTRIBUTING.md).\n\n> **📖 Contributing to documentation?** The LiteLLM docs have moved to a separate repository: [BerriAI/litellm-docs](https://github.com/BerriAI/litellm-docs). Please open doc PRs there. Docs are served at [docs.litellm.ai](https://docs.litellm.ai).","github_created_at":"2023-07-27T00:09:52+00:00","created_at":"2026-07-07T15:08:12.441998+00:00","updated_at":"2026-08-01T06:00:37.44739+00:00","categories":[{"slug":"inference-serving","name":"Inference & Serving","url":"https://www.graphcanon.com/categories/inference-serving","markdown_url":"https://www.graphcanon.com/categories/inference-serving.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/inference-serving"},{"slug":"llm-frameworks","name":"LLM Frameworks","url":"https://www.graphcanon.com/categories/llm-frameworks","markdown_url":"https://www.graphcanon.com/categories/llm-frameworks.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/llm-frameworks"}],"tags":[{"slug":"ai-gateway","name":"ai-gateway"},{"slug":"azure-openai","name":"azure-openai"},{"slug":"bedrock","name":"bedrock"},{"slug":"llm","name":"llm"},{"slug":"openai","name":"openai"},{"slug":"vertex-ai","name":"vertex-ai"}],"trust":{"provenance":{"is_fork":false,"github_id":671269505,"owner_type":"Organization","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-08-01T06:00:36.697Z","maintenance":{"label":"Very active","score":96,"methodology":"github_public_v1","releases_90d":30,"days_since_push":0,"last_release_at":"2026-08-01T01:15:56Z"},"security_summary":{"status":"findings","scanner":"osv@v1","low_count":2,"high_count":0,"last_scan_at":"2026-07-11T10:28:29.450Z","medium_count":0,"scan_profile":"deps","critical_count":0}},"capability_facts":{"mcp":{"source":"repo_scan","observed_at":"2026-08-01T06:00:37.126Z","server_manifest":false},"scan":{"source":"repo_scan","observed_at":"2026-08-01T06:00:37.126Z"},"deploy":{"source":"dockerfile:Dockerfile","self_host":true,"observed_at":"2026-08-01T06:00:37.126Z","managed_saas":false},"has_cli":{"value":true,"source":"pyproject.toml:[project.scripts]","observed_at":"2026-08-01T06:00:37.126Z"},"languages":{"value":["python","javascript"],"source":"github.language+package.json+pyproject.toml","observed_at":"2026-08-01T06:00:37.126Z"},"has_docker":{"value":true,"source":"dockerfile:Dockerfile","observed_at":"2026-08-01T06:00:37.126Z"},"license_spdx":{"value":"Other","source":"github.license","observed_at":"2026-08-01T06:00:37.126Z"}},"decision_facts":{"hosting":null,"pricing":{"model":"freemium","summary":"While the core functionality is provided free, specific extended features might require a paid plan."},"requirements":{"min_ram_gb":null,"requires_docker":true},"constraints":{"min_ram_gb":null,"pricing_model":"freemium","requires_docker":true},"when_to_use":["When you need to integrate multiple LLM (Language Learning Modelling) APIs into your application across different providers like Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, Hugging"],"when_not_to_use":["If your project only requires interaction with a single LLM API and basic functionalities, litellm may be overkill."],"source":"enrich:decision_facts","observed_at":"2026-07-11T10:48:29.638Z"},"constraint_facets":{"min_ram_gb":null,"pricing_model":"freemium","requires_docker":true},"decision_summary":[{"label":"Pricing","value":"freemium - While the core functionality is provided free, specific extended features might require a paid plan."},{"label":"Requirements","value":"Requires Docker"},{"label":"Adopt for","value":"litellm is a Python SDK and Proxy Server that facilitates the interaction with over 100 LLM APIs, offering features such as cost tracking, guardrails, load balancing, and logging."},{"label":"License detail","value":"The licensing terms for LiteLLM are provided under a license type categorized as 'Other'; details of the exact license should be referenced directly from its source."}]}}