GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026
129views this month
Decision brief
litellm is a Rust core with a Python SDK that serves as an AI gateway for over 100 LLM APIs, offering features like cost tracking, guardrails, load balancing, and logging.
Good fit when
- When you need a fast and lightweight AI gateway that supports over 100 LLM APIs in OpenAI or native format.
- If you require robust cost tracking, guardrails, load balancing, and logging for your LLM API calls.
Avoid when
- If you are working in an environment where Rust or Python is not supported or preferred.
- When you need a tool that is not focused on performance and lightweight operations, as litellm is optimized for speed and efficiency.
Observed Sep 18, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Very active (0d since push)
- As of Sep 18, 2026
- Provenance
- Not a fork · Organization account
- As of Sep 18, 2026
- Security (OSV)
- 8 low (8 low)
- As of Sep 18, 2026
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
pip install litellmHow it fits your stack(33)
Typed graph edges - alternatives, integrations, successors, and dependencies. Ranked by relationship type, not raw GitHub stars.
Alternative
Integrates
Depends on
Related
Relationship graph
Optional deeper exploration of typed edges and category neighbours.
Similar tools
Same-category neighbours not already linked as typed edges.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
Rust core with Python SDK for calling over 100 LLM APIs in OpenAI or native format, featuring cost tracking, guardrails, load balancing, and logging
Capability facts
- Deploy
- Self-host
Source: dockerfile:Dockerfile · Sep 18, 2026
- Docker
- Dockerfile present
Source: dockerfile:Dockerfile · Sep 18, 2026
- CLI
- CLI entrypoint
Source: pyproject.toml:[project.scripts] · Sep 18, 2026
- MCP server
- No MCP server detected
Source: repo_scan · Sep 18, 2026
- Languages
- python, javascript
Source: github.language+package.json+pyproject.toml · Sep 18, 2026
Categories
Graph entities
Tags
README
Verify Docker Image Signatures All LiteLLM Docker images published to GHCR are signed with cosign. Every release is signed with the same key introduced in commit . Verify using the pinned commit hash (recommended): A commit hash is cryptographically immutable, so this is the stro...
For agents
This page has a .md twin and JSON over the API.