litellm vs ollama
A neutral, constraint-first comparison - live GitHub stats and typed relationships, not marketing.
| litellm | ollama | |
|---|---|---|
| Tagline | Python SDK and Proxy Server for calling over 100 LLM APIs in OpenAI format | Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. |
| Stars | 53k | 176k |
| Forks | 9.5k | 17k |
| Open issues | 3.7k | 3.4k |
| Language | Python | Go |
| License | Other | MIT |
| Last pushed | Jul 7, 2026 | Jul 7, 2026 |
| Categories | LLM Frameworks, Inference & Serving | LLM Frameworks, AI Agents |
litellm
A Python SDK along with a proxy server (AI Gateway) designed to facilitate the interaction with numerous large language models, providing functionalities like cost tracking, load balancing, guardrails, and logging across various providers such as Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM.
Python
ollama
Ollama is a platform for deploying and interacting with various large language models (LLMs) such as Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, and Gemma on macOS, Windows, Linux, and Docker environments.
Go