litellm vs llmflows

A neutral, constraint-first comparison - live GitHub stats and typed relationships, not marketing.

litellmllmflows
TaglinePython SDK and Proxy Server for calling over 100 LLM APIs in OpenAI formatSimple, Explicit and Transparent LLM Apps
Stars53k706
Forks9.5k35
Open issues3.7k19
LanguagePythonPython
LicenseOtherMIT
Last pushedJul 7, 2026Feb 20, 2025
CategoriesLLM Frameworks, Inference & ServingEvaluation & Observability, Inference & Serving

litellm

A Python SDK along with a proxy server (AI Gateway) designed to facilitate the interaction with numerous large language models, providing functionalities like cost tracking, load balancing, guardrails, and logging across various providers such as Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM.

Python

llmflows

LLMFlows is a framework that allows the creation of clear, transparent applications using large language models (LLMs), offering minimalistic abstractions for monitoring, maintenance, and debugging.

Python