Results for “evaluation”
19 tools · Python
lmms-eval
EvolvingLMMs-Lab/lmms-eval
One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
opik
comet-ml/opik
Comprehensive tracing, automated evaluations, and production-ready dashboards for LLM applications.
giskard-oss
Giskard-AI/giskard-oss
Eval and test library for AI agents
trulens
truera/trulens
Evaluation and Tracking for LLM Experiments and AI Agents
continuous-eval
relari-ai/continuous-eval
Data-Driven Evaluation for LLM-Powered Applications
phoenix
Arize-ai/phoenix
AI Observability & Evaluation
mlflow
mlflow/mlflow
The open source AI engineering platform for agents, LLMs, and ML models
RagaAI-Catalyst
raga-ai-hub/RagaAI-Catalyst
Python SDK for Agent AI Observability, Monitoring and Evaluation Framework
prometheus-eval
prometheus-eval/prometheus-eval
Evaluate your LLM's response with Prometheus and GPT4
ragas
vibrantlabsai/ragas
Supercharge Your LLM Application Evaluations
uptrain
uptrain-ai/uptrain
Unified platform for evaluating and improving Generative AI applications.
VLMEvalKit
open-compass/VLMEvalKit
A Toolkit for Evaluating Large Vision-Language Models
adk-python
google/adk-python
An open-source, code-first Python framework for building, evaluating, and deploying sophisticated AI agents with flexibility and control.
agent-starter-pack
GoogleCloudPlatform/agent-starter-pack
Ship AI Agents to Google Cloud in minutes, not months
LLM-Engineers-Handbook
PacktPublishing/LLM-Engineers-Handbook
Official repository for LLM Engineer's Handbook
intellagent
plurai-ai/intellagent
Framework for comprehensive diagnosis and optimization of agents using simulated, realistic synthetic interactions
LLM-Agents-Ecosystem-Handbook
oxbshw/LLM-Agents-Ecosystem-Handbook
Practical operating manual for modern LLM agent systems
deep-searcher
zilliztech/deep-searcher
Open Source Deep Research Alternative to Reason and Search on Private Data
Promptify
promptslab/Promptify
Task-based NLP engine for structured outputs from LLMs