“llm-ops”

kong

🦍 The API and AI Gateway

OpenLLM

Run any open-source LLMs as OpenAI compatible API endpoint in the cloud.

AutoRAG

AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation

langwatch

The platform for LLM evaluations and AI agent testing

athina-evals

Python SDK for running evaluations on LLM generated responses