Home/Search

Search results

“evaluations”

40 tools · ranked by relevance and freshness, not ad spend.

Result neighbourhood

Top matches for your query, linked as a graph hub. Follow any node to drill in.

FilterSort · Relevance
lmms-eval

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

Pythonagiaudio-evaluationpushed today
4.3k
today
promptfoo

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI.

TypeScriptcici-cdpushed today
23k
today
opik

Comprehensive tracing, automated evaluations, and production-ready dashboards for LLM applications.

Pythonevaluationhacktoberfestpushed today
20k
today
agenta

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScriptagentsevaluationpushed today
4.3k
today
giskard-oss

Eval and test library for AI agents

Pythonagent-evaluationai-red-teampushed today
5.5k
today
trulens

Evaluation and Tracking for LLM Experiments and AI Agents

Pythonagent-evaluationagentopspushed 1w
3.4k
1w
continuous-eval

Data-Driven Evaluation for LLM-Powered Applications

Pythonevaluation-frameworkevaluation-metricspushed 1y
516
1y
prometheus-eval

Evaluate your LLM's response with Prometheus and GPT4

Pythonevaluationgpt4pushed 1y
1.1k
1y
phoenix

AI Observability & Evaluation

Pythonagentsai-monitoringpushed today
10k
today
mlflow

The open source AI engineering platform for agents, LLMs, and ML models

Pythonagentopsagentspushed today
27k
today
RagaAI-Catalyst

Python SDK for Agent AI Observability, Monitoring and Evaluation Framework

Pythonagentic-aiagentic-ai-developmentpushed 4mo
16k
4mo
ragas

Supercharge Your LLM Application Evaluations

Pythonevaluationllmpushed 4mo
15k
4mo
coze-loop

Next-generation AI Agent Optimization Platform

Goagentagent-evaluationpushed today
5.6k
today
langfuse

Open source AI engineering platform

TypeScriptanalyticsautogenpushed today
31k
today
VLMEvalKit

A Toolkit for Evaluating Large Vision-Language Models

Pythonchatgptclaudepushed 2d
4.3k
2d
langwatch

Platform for LLM evaluations and AI agent testing

TypeScriptaianalyticspushed today
3.3k
today
lmnr

Open-source observability platform for AI agents

TypeScriptagent-observabilityagentspushed today
3.1k
today
uptrain

Unified platform to evaluate and improve Generative AI applications

Pythonautoevaluationevaluationpushed 1y
2.4k
1y
helicone

Açık kaynak LLM izleme platformu. Tek satır kod ile izle, değerlendir ve deney.

TypeScriptagent-monitoringanalyticspushed 2d
5.9k
2d
ChainForge

An open-source visual environment for battle-testing prompts to LLMs

TypeScriptaievaluationpushed 3w
3.0k
3w
adk-python

An open-source, code-first Python framework for building, evaluating, and deploying sophisticated AI agents with flexibility and control.

Pythonagentagenticpushed today
21k
today
cua

Open-source infrastructure for training and evaluating AI agents to control full desktop environments.

HTMLagentai-agentpushed today
19k
today
langtrace

Langtrace 🔍 Open Telemetry based end-to-end observability tool for LLM applications

TypeScriptaidatasetspushed 7mo
1.2k
7mo
evidently

Evidently is an open-source ML and LLM observability framework.

Jupyter Notebookdata-driftdata-qualitypushed 2mo
7.7k
2mo
WeKnora

Turn Documents into Living Knowledge with RAG, Agents and Auto-Wiki

Goagentagenticpushed today
18k
today
agent-starter-pack

Ship AI Agents to Google Cloud in minutes, not months

Pythonagentsgcppushed 1w
6.5k
1w
LLM-Engineers-Handbook

Official repository for LLM Engineer's Handbook

Pythonawsfine-tuning-llmpushed 2mo
5.2k
2mo
openlit

Open source platform for AI Engineering

TypeScriptai-observabilityamd-gpupushed today
2.6k
today
intellagent

Uncover Your Agent's Blind Spots

Pythonagentevaluationpushed today
1.3k
today
LLM-Agents-Ecosystem-Handbook

One-stop handbook for building, deploying, and understanding LLM agents

Pythonaiai-agentpushed 1w
533
1w
Awesome-Multimodal-Large-Language-Models

Latest Advances on Multimodal Large Language Models

chain-of-thoughtin-context-learningpushed 5d
18k
5d
easy-dataset

A powerful tool for creating datasets for LLM fine-tuning, RAG, and Eval

JavaScriptdatasetfine-tuningpushed 2mo
15k
2mo
bisheng

LLM DevOps Platform for Enterprise AI Applications

TypeScriptagentaipushed today
12k
today
LLM-Agent-Paper-List

Curated list of papers related to Large Language Model Based Agents as per the SCIS cover paper survey.

agentlarge-language-modelspushed 9mo
8.2k
9mo
deep-searcher

Open Source Deep Research Alternative to Reason and Search on Private Data

Pythonagentagentic-ragpushed 7mo
7.9k
7mo
Promptify

Task-based NLP engine for structured outputs from LLMs

Pythonchatgptchatgpt-apipushed 3mo
4.6k
3mo
bootcamp

Interactive tutorials and examples for mastering Milvus with unstructured data applications.

Jupyter Notebookaudio-searchdeep-learningpushed 2mo
2.4k
2mo
JustHireMe

Local-first AI job intelligence workbench for scraping roles, ranking fit, and generating tailored application materials.

Pythonagentsaipushed 3d
2.1k
3d
Large-Language-Model-Notebooks-Course

Practical course about Large Language Models

Jupyter Notebookchatbotsfine-tuning-llmpushed 1mo
1.8k
1mo
cv-santiago

Interactive CV with AI chat integration

HTMLaichatbotpushed 5d
731
5d

Command menu

Search tools or jump to a page