oss-llmops-stack
Modular open source LLMOps stack for LLM API unification, observability and prompt management
GraphCanon updated 3w · GitHub synced 3w
Decision brief
The OSS LLMOps Stack is designed for managing and unifying LLM APIs with LiteLLM, and providing detailed observability through Langfuse.
Good fit when
- When you need to unify Multiple Large Language Model (LLM) APIs using LiteLLM's API mediation capabilities for efficient routing, cost control, and high-availability support.
- For teams requiring robust prompt management with versioning features and performance evaluations which can be handled by Langfuse.
Avoid when
- If your operational requirements are simple and you do not need comprehensive observability metrics or advanced LLM API unification capabilities provided by the stack.
- In scenarios where you prefer a proprietary software solution over an open-source tool for security, support, or compliance reasons.
- Requirements:
- Ensure your environment supports both LiteLLM and Langfuse functionalities for seamless operation of the OSS LLMOps Stack.; Consider server capacity to handle the additional load introduced by using this stack for API unification and observability services.
Observed Jul 16, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Very active (0d since push)
- As of 3w
- Provenance
- Not a fork · Organization account
- As of 3w
- Security (OSV)
- No lockfile
- As of 1mo
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
git clone https://github.com/langfuse/oss-llmops-stackHow it fits your stack(1)
Typed graph edges - alternatives, integrations, successors, and dependencies. Ranked by relationship type, not raw GitHub stars.
Relationship graph
Optional deeper exploration of typed edges and category neighbours.
Similar tools
Same-category neighbours not already linked as typed edges.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
The OSS LLMOps Stack comprises LiteLLM for LLM API unification, routing, cost control, and high-availability support alongside Langfuse for observability features including prompt versioning and performance evaluations.
Capability facts
No sourced capability facts yet. Facts appear after ingest scans repo manifests (Dockerfile, package.json, MCP configs).
Categories
Tags
README
OSS LLMOps Stack
[!NOTE]
Learn more: oss-llmops-stack.com
For agents
This page has a .md twin and JSON over the API.