Home/AI Agents/eval-view
eval-view logo

eval-view

hidai25/eval-view

Regression testing for AI agents

GraphCanon updated 3w · GitHub synced 3w

126 stars21 forksLast push 4w Python Apache-2.0

Decision brief

Regression testing for AI agents to detect behavioral changes and output quality regressions over time.

Good fit when

  • When you need to track and assess the behavior consistency of your AI agent across versions without involving live API calls.
  • If you are working with tools like LangGraph, CrewAI, OpenAI, or Anthropic where you require robust behavior comparison capabilities.

Avoid when

  • If you do not need to monitor specific behavioral characteristics such as tool call sequences and parameter consistency over time.
  • When real-time output quality evaluation is critical, as eval-view's offline diffing does not provide immediate feedback on output changes without an LLM judge.
Pricing:
freemium - Free to use under the terms of the Apache License, Version 2.0.
Requirements:
Python environment is required for installation and usage.; Installation with pip: `pip install evalview`; Offline support means no live API keys necessary for the basic diff functionality.

Observed Jul 17, 2026 · Source: enrich:decision_facts

Verify the decision

Maintenance and security

Full trust report
Maintenance
Very active (6d since push)
As of 3w
Provenance
Not a fork · Personal account
As of 3w
Security (OSV)
1 medium (1 medium)
As of 1mo

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

pip install eval-view
PyPI

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

A tool to snapshot and compare AI agent behavior over time, identifying regressions in functionality or output quality.

Capability facts

Deploy
Self-host

Source: dockerfile:Dockerfile · Aug 2, 2026

Docker
Dockerfile present

Source: dockerfile:Dockerfile · Aug 2, 2026

CLI
CLI entrypoint

Source: pyproject.toml:[project.scripts] · Aug 2, 2026

MCP server
No MCP server detected

Source: repo_scan · Aug 2, 2026

Languages
python, javascript, typescript

Source: github.language+package.json+pyproject.toml · Aug 2, 2026

Categories

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Python runtimePython

Source: README excerpt (regex_v1, Aug 2, 2026)

pip install evalview
Source link

Tags

README

Quick Start

pip install evalview
evalview snapshot    # Record your agent's current behavior as the baseline
evalview check       # After any change, diff against the baseline

That's the whole loop. check returns one of:

  ✓ login-flow        PASSED          behavior matches baseline
  ⚠ refund-request    TOOLS_CHANGED   called a different tool, or in a different order
  ✗ billing-dispute   REGRESSION      score dropped — output quality fell

It diffs the whole trajectory — tool names, parameters, and order — not just the final string. The deterministic tool + sequence diff runs offline, with no API key. Add an LLM judge only when you want output-quality scoring.

No agent yet? See it work in 30 seconds:

evalview demo

For agents

This page has a .md twin and JSON over the API.

Was this helpful?

Anonymous feedback helps us improve pages and translations.