Home/Search

Search results

“evaluations”

40 tools · ranked by relevance and freshness, not ad spend.

lmms-eval

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

Pythonagiaudio-evaluation
4.3k
stars
promptfoo

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI.

TypeScriptcici-cd
23k
stars
opik

Comprehensive tracing, automated evaluations, and production-ready dashboards for LLM applications.

Pythonevaluationhacktoberfest
20k
stars
agenta

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

TypeScriptagentsevaluation
4.3k
stars
giskard-oss

Eval and test library for AI agents

Pythonagent-evaluationai-red-team
5.5k
stars
trulens

Evaluation and Tracking for LLM Experiments and AI Agents

Pythonagent-evaluationagentops
3.4k
stars
continuous-eval

Data-Driven Evaluation for LLM-Powered Applications

Pythonevaluation-frameworkevaluation-metrics
516
stars
prometheus-eval

Evaluate your LLM's response with Prometheus and GPT4

Pythonevaluationgpt4
1.1k
stars
phoenix

AI Observability & Evaluation

Pythonagentsai-monitoring
10k
stars
mlflow

The open source AI engineering platform for agents, LLMs, and ML models

Pythonagentopsagents
27k
stars
RagaAI-Catalyst

Python SDK for Agent AI Observability, Monitoring and Evaluation Framework

Pythonagentic-aiagentic-ai-development
16k
stars
ragas

Supercharge Your LLM Application Evaluations

Pythonevaluationllm
15k
stars
coze-loop

Next-generation AI Agent Optimization Platform

Goagentagent-evaluation
5.6k
stars
langfuse

Open source AI engineering platform

TypeScriptanalyticsautogen
31k
stars
VLMEvalKit

A Toolkit for Evaluating Large Vision-Language Models

Pythonchatgptclaude
4.3k
stars
langwatch

Platform for LLM evaluations and AI agent testing

TypeScriptaianalytics
3.3k
stars
lmnr

Open-source observability platform for AI agents

TypeScriptagent-observabilityagents
3.1k
stars
uptrain

Unified platform to evaluate and improve Generative AI applications

Pythonautoevaluationevaluation
2.4k
stars
helicone

Açık kaynak LLM izleme platformu. Tek satır kod ile izle, değerlendir ve deney.

TypeScriptagent-monitoringanalytics
5.9k
stars
ChainForge

An open-source visual environment for battle-testing prompts to LLMs

TypeScriptaievaluation
3.0k
stars
adk-python

An open-source, code-first Python framework for building, evaluating, and deploying sophisticated AI agents with flexibility and control.

Pythonagentagentic
21k
stars
cua

Open-source infrastructure for training and evaluating AI agents to control full desktop environments.

HTMLagentai-agent
19k
stars
langtrace

Langtrace 🔍 Open Telemetry based end-to-end observability tool for LLM applications

TypeScriptaidatasets
1.2k
stars
evidently

Evidently is an open-source ML and LLM observability framework.

Jupyter Notebookdata-driftdata-quality
7.7k
stars
WeKnora

Turn Documents into Living Knowledge with RAG, Agents and Auto-Wiki

Goagentagentic
18k
stars
agent-starter-pack

Ship AI Agents to Google Cloud in minutes, not months

Pythonagentsgcp
6.5k
stars
LLM-Engineers-Handbook

Official repository for LLM Engineer's Handbook

Pythonawsfine-tuning-llm
5.2k
stars
openlit

Open source platform for AI Engineering

TypeScriptai-observabilityamd-gpu
2.6k
stars
intellagent

Uncover Your Agent's Blind Spots

Pythonagentevaluation
1.3k
stars
LLM-Agents-Ecosystem-Handbook

One-stop handbook for building, deploying, and understanding LLM agents

Pythonaiai-agent
533
stars
Awesome-Multimodal-Large-Language-Models

Latest Advances on Multimodal Large Language Models

chain-of-thoughtin-context-learning
18k
stars
easy-dataset

A powerful tool for creating datasets for LLM fine-tuning, RAG, and Eval

JavaScriptdatasetfine-tuning
15k
stars
bisheng

LLM DevOps Platform for Enterprise AI Applications

TypeScriptagentai
12k
stars
LLM-Agent-Paper-List

Curated list of papers related to Large Language Model Based Agents as per the SCIS cover paper survey.

agentlarge-language-models
8.2k
stars
deep-searcher

Open Source Deep Research Alternative to Reason and Search on Private Data

Pythonagentagentic-rag
7.9k
stars
Promptify

Task-based NLP engine for structured outputs from LLMs

Pythonchatgptchatgpt-api
4.6k
stars
bootcamp

Interactive tutorials and examples for mastering Milvus with unstructured data applications.

Jupyter Notebookaudio-searchdeep-learning
2.4k
stars
JustHireMe

Local-first AI job intelligence workbench for scraping roles, ranking fit, and generating tailored application materials.

Pythonagentsai
2.1k
stars
Large-Language-Model-Notebooks-Course

Practical course about Large Language Models

Jupyter Notebookchatbotsfine-tuning-llm
1.8k
stars
cv-santiago

Interactive CV with AI chat integration

HTMLaichatbot
731
stars