oss-llmops-stack
Modular open source LLMOps stack for LLM API unification, observability and prompt management
GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026
40views this month
Decision brief
The OSS LLMOps Stack is designed for managing and unifying LLM APIs with LiteLLM, and providing detailed observability through Langfuse.
Good fit when
- When you need to unify Multiple Large Language Model (LLM) APIs using LiteLLM's API mediation capabilities for efficient routing, cost control, and high-availability support.
- For teams requiring robust prompt management with versioning features and performance evaluations which can be handled by Langfuse.
Avoid when
- If your operational requirements are simple and you do not need comprehensive observability metrics or advanced LLM API unification capabilities provided by the stack.
- In scenarios where you prefer a proprietary software solution over an open-source tool for security, support, or compliance reasons.
- Requirements:
- Ensure your environment supports both LiteLLM and Langfuse functionalities for seamless operation of the OSS LLMOps Stack.; Consider server capacity to handle the additional load introduced by using this stack for API unification and observability services.
Observed Jul 16, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Steady (53d since push)
- As of Sep 20, 2026
- Provenance
- Not a fork · Organization account
- As of Sep 20, 2026
- Security (OSV)
- No lockfile
- As of Jul 11, 2026
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
git clone https://github.com/langfuse/oss-llmops-stackHow it fits your stack(1)
Typed graph edges - alternatives, integrations, successors, and dependencies. Ranked by relationship type, not raw GitHub stars.
Relationship graph
Optional deeper exploration of typed edges and category neighbours.
Similar tools
Same-category neighbours not already linked as typed edges.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
The OSS LLMOps Stack comprises LiteLLM for LLM API unification, routing, cost control, and high-availability support alongside Langfuse for observability features including prompt versioning and performance evaluations.
Capability facts
No sourced capability facts yet. Facts appear after ingest scans repo manifests (Dockerfile, package.json, MCP configs).
Categories
Tags
README
OSS LLMOps Stack [!NOTE] Learn more: oss llmops stack.com
For agents
This page has a .md twin and JSON over the API.