Results for “llm-evaluation”

langfuse

langfuse/langfuse

Langfuse: Open source AI engineering platform for LLM evaluation, observability, and prompt management.

mlflow

mlflow/mlflow

The open source AI engineering platform for agents, LLMs, and ML models.

promptfoo

promptfoo/promptfoo

Test your prompts, agents, and RAGs. Evaluate LLM performance with red teaming/pentesting/vulnerability scanning.

opik

comet-ml/opik

Debug, evaluate, and monitor your LLM applications with comprehensive tracing, automated evaluations, and production-ready dashboards.

phoenix

Arize-ai/phoenix

AI Observability & Evaluation

helicone

Helicone/helicone

Open source LLM observability platform

giskard-oss

Giskard-AI/giskard-oss

Evaluation & Testing library for LLM Agents

LLM-Engineers-Handbook

PacktPublishing/LLM-Engineers-Handbook

LLM Engineer's Handbook by Paul Iusztin and Maxime Labonne

lmms-eval

EvolvingLMMs-Lab/lmms-eval

Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

agenta

Agenta-AI/agenta

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

trulens

truera/trulens

Evaluation and Tracking for LLM Experiments and AI Agents

lmnr

lmnr-ai/lmnr

Laminar - open-source observability platform purpose-built for AI agents.

continuous-eval

relari-ai/continuous-eval

Data-Driven Evaluation for LLM-Powered Applications