Home/Evaluation & Observability/AdaRubrics

AdaRubrics

alphadl/AdaRubrics

Adaptive Dynamic Rubric Evaluator for Agent Trajectories

GitHub

GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026

36views this month

362 stars37 forksLast push Aug 24, 2026 Python Apache-2.0

Decision brief

AdaRubrics serves as an Adaptive Dynamic Rubric Evaluator specifically for assessing AI agent and language model performance based on evolving rubrics tailored to the agents' paths.

Good fit when

When you need dynamic evaluation criteria that adapt in real-time according to how your AI agents or language models are performing their tasks.
If your project involves multiple stages of AI agent development where continuous adaptation of evaluation metrics is necessary for improving performance over time.

Avoid when

If fixed rubrics with static evaluation criteria suffice, AdaRubrics provides more complexity than needed.
For projects that do not require real-time adjustments in evaluation methods as the AI agents' or models' trajectories progress.

Observed Jul 17, 2026 · Source: enrich:decision_facts

AdaRubrics alternatives Trust report

Verify the decision

Maintenance and security

Full trust report

Maintenance: Active (27d since push); As of Sep 20, 2026
Provenance: Not a fork · Personal account; As of Sep 20, 2026
Security (OSV): No lockfile; As of Jul 11, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

pip install AdaRubrics

PyPI

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

deepeval

LLM Evaluation Framework.

18k★

XAgent

An Autonomous LLM Agent for Complex Task Solving

8.5k★

LLM-Agent-Paper-List

Must-read papers for LLM-based agents.

8.2k★

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

AdaRubric is an evaluation tool designed to assess the performance of AI agents and language models based on dynamic rubrics that adapt according to agent trajectories.

Capability facts

Languages: python
Source: github.language+pyproject.toml · Sep 20, 2026

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Python runtimePython

Source: README excerpt (regex_v1, Sep 20, 2026)

```python import asyncio

Source link

README

Installation Set in your environment (or pass via config). YAML config support requires . Quick Start Run the full example:

For agents

This page has a .md twin and JSON over the API.

/tools/alphadl-adarubrics.md GET /api/graphcanon/tools/alphadl-adarubrics GET /api/graphcanon/graph?tool=alphadl-adarubrics