GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026
63views this month
Decision brief
ClawBench offers an open-source benchmark framework for evaluating browser-based AI agents on real-world online tasks.
Good fit when
- You are developing a browser AI agent and wish to measure its performance against everyday online activities, as ClawBench specifically simulates these scenarios.
- Your project involves the use of Chrome extensions in conjunction with LLMS, requiring benchmarking that aligns with this specific integration.
Avoid when
- If your focus is solely on backend server-based AI evaluations without a browser interface involvement, ClawBench will not be the appropriate choice.
- For those developing standalone applications or mobile agents, ClawBench’s browser-centric tasks will not reflect their operational capabilities accurately.
- Requirements:
- Requires setup for browser automation tasks within the Chrome environment.
Observed Jul 16, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Very active (0d since push)
- As of Sep 20, 2026
- Provenance
- Not a fork · Organization account
- As of Sep 20, 2026
- Security (OSV)
- No lockfile
- As of Jul 11, 2026
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
pip install ClawBench PyPISimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
ClawBench is an open-source benchmark framework tailored to evaluate browser-based AI agents in handling everyday online tasks.
Capability facts
- CLI
- CLI entrypoint
Source: pyproject.toml:[project.scripts] · Sep 20, 2026
- Languages
- python
Source: github.language+pyproject.toml · Sep 20, 2026
Categories
Compatibility
Sourced claims from the README excerpt - not unsourced marketing copy.
Source: README excerpt (regex_v1, Sep 20, 2026)
`pipx install clawbench-eval` and `python -m pip install clawbench-eval` work too. The installed commands are `clawbench`Source link
Tags
README
<img src="assets/icons/rocket.svg" width="24" height="24" Quick start <sub <i Clone → configure → run. Root uv package. Docker isolated harnesses.</i </sub Driving a coding agent instead? Point it at and prompt away. Install and work too. The installed commands are...
For agents
This page has a .md twin and JSON over the API.