LiteLLM

langfuse

Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.

onyx

Open Source AI Platform - AI Chat with advanced features that works with every LLM

pandas-ai

Chat with your database or your datalake using LLMs and RAG.

pydantic-ai

Python AI SDK with typed, extensible agent loop

RD-Agent

Automating high-value R&D processes through AI-driven data science and model development.

bifrost

Fast Enterprise AI Gateway with Adaptive Load Balancer and Guardrails

Promptify

Task-based NLP engine with Pydantic structured outputs

optillm

Optimizing inference proxy for LLMs

textgrad

Automatic 'Differentiation' via Text using Large Language Models to Backpropagate Textual Gradients

trulens

Evaluation and Tracking for LLM Experiments and AI Agents

lmnr

Laminar - open-source observability platform for AI agents

prometheus-eval

Evaluate your LLM's response with Prometheus and GPT4

Lynkr

Streamline your workflow with Lynkr, a CLI tool for efficient code interactions using Claude Code CLI.

vigil-llm

Detect prompt injections and other risky inputs in LLMs