LiteLLM

langfuse

Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets

onyx

Open Source AI Platform - AI Chat with advanced features that works with every LLM

pandas-ai

Chat with your database or your datalake using LLMs and RAG.

pydantic-ai

GenAI Agent Framework, the Pydantic way

RD-Agent

Automating high-value R&D processes through AI-driven data science and model development.

bifrost

Fast Enterprise AI Gateway with Adaptive Load Balancer and Guardrails

Promptify

Task-based NLP engine with Pydantic structured outputs

optillm

Optimizing inference proxy for LLMs

textgrad

Automatic 'Differentiation' via Text using Large Language Models to Backpropagate Textual Gradients

trulens

Evaluation and Tracking for LLM Experiments and AI Agents

lmnr

Open-source observability platform for AI agents.

prometheus-eval

Evaluate your LLM's response with Prometheus and GPT4

Lynkr

Streamline your workflow with Lynkr, a CLI tool for efficient code interactions using Claude Code CLI.

vigil-llm

Detect prompt injections and other risky inputs in LLMs