Results for “llmops”

llm-app

pathwaycom/llm-app

Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data.

litellm

BerriAI/litellm

Python SDK and Proxy Server for calling over 100 LLM APIs in OpenAI format

langfuse

langfuse/langfuse

Open source AI engineering platform

composio

ComposioHQ/composio

Composio SDK powers AI agents to turn intent into action with TypeScript and Python SDKs for seamless integration.

mlflow

mlflow/mlflow

The open source AI engineering platform for agents, LLMs, and ML models

llm-action

liguodongiot/llm-action

分享大模型技术原理与实战经验，涵盖工程化和应用落地

promptfoo

promptfoo/promptfoo

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI.

serve

jina-ai/serve

Build multimodal AI applications with cloud-native stack

opik

comet-ml/opik

Comprehensive tracing, automated evaluations, and production-ready dashboards for LLM applications.

SuperAGI

TransformerOptimus/SuperAGI

SuperAGI - A dev-first open source autonomous AI agent framework

RagaAI-Catalyst

raga-ai-hub/RagaAI-Catalyst

Python SDK for Agent AI Observability, Monitoring and Evaluation Framework

ragas

vibrantlabsai/ragas

Supercharge Your LLM Application Evaluations

OpenLLM

bentoml/OpenLLM

Self-Hosting LLMs Made Easy

gateway

Portkey-AI/gateway

A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs

bisheng

dataelement/bisheng

LLM DevOps Platform for Enterprise AI Applications

phoenix

Arize-ai/phoenix

AI Observability & Evaluation

metaflow

Netflix/metaflow

Human-centric framework to build and manage AI/ML systems

BentoML

bentoml/BentoML

The easiest way to serve AI apps and models

rig

0xPlaygrounds/rig

⚙️🦀 Build modular and scalable LLM Applications in Rust

evidently

evidentlyai/evidently

Evidently: Open-source ML and LLM observability framework

openllmetry

traceloop/openllmetry

Open-source observability for your LLM application

clearml

clearml/clearml

ClearML - Auto-Magical CI/CD to streamline your AI workload

plano

katanemo/plano

Plano is an AI-native proxy and data plane for agentic apps with built-in orchestration, safety, observability, and smart LLM routing.

agent-starter-pack

GoogleCloudPlatform/agent-starter-pack

A repository for production-ready templates to deploy AI Agents on Google Cloud.

bifrost

maximhq/bifrost

Fastest enterprise AI gateway with adaptive load balancer, cluster mode, guardrails, and support for over 1000 models.

helicone

Helicone/helicone

Open source LLM observability platform

Awesome-LLMOps

tensorchord/Awesome-LLMOps

An awesome & curated list of the best LLMOps tools for developers

coze-loop

coze-dev/coze-loop

Next-generation AI Agent Optimization Platform

giskard-oss

Giskard-AI/giskard-oss

Evaluation & Testing library for LLM Agents

zenml

zenml-io/zenml

One AI Platform From Pipelines to Agents

superduper

superduper-io/superduper

End-to-end framework for building custom AI applications and agents

LLM-Engineers-Handbook

PacktPublishing/LLM-Engineers-Handbook

LLM Engineer's Handbook by Paul Iusztin and Maxime Labonne

cube-studio

tencentmusic/cube-studio

一站式云原生机器学习/深度学习/大模型AI平台

llm-twin-course

decodingai-magazine/llm-twin-course

Learn to build an end-to-end production-ready LLM & RAG system using LLMOps best practices

agenta

Agenta-AI/agenta

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

lorax

predibase/lorax

Multi-LoRA inference server that scales to serve thousands of fine-tuned LLMs on a single GPU

Acontext

memodb-io/Acontext

Agent Skills as a Memory Layer

trulens

truera/trulens

Evaluation and Tracking for LLM Experiments and AI Agents

langwatch

langwatch/langwatch

The platform for LLM evaluations and AI agent testing

pezzo

pezzolabs/pezzo

PropertyParams Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more.