Home/AI Agents/WeaveBench
WeaveBench logo

WeaveBench

weavebench/WeaveBench

A Long-Horizon Real-World Benchmark for Computer-Use Agents with Hybrid Interfaces

GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026

62views this month

167 stars4 forksLast push Aug 22, 2026 Python MIT

Decision brief

WeaveBench is designed for evaluating computer-use agents that integrate both GUI and CLI interactions in real-world scenarios across various work domains.

Good fit when

  • Use WeaveBench if you need to assess agents capable of handling tasks that require intermingling graphical user interface operations with command-line or code-based actions.
  • Opt for this tool when working on projects where performance evaluation must account for a hybrid interaction style, as opposed to focusing solely on GUI or CLI capabilities.

Avoid when

  • Avoid WeaveBench if your testing needs do not involve scenarios that require the integration of both GUI and CLI operations.
  • Do not use it when you are specifically interested only in benchmarking agents designed for single-channel tasks, either strictly CLI-based or purely graphical interface-driven.

Observed Jul 15, 2026 · Source: enrich:decision_facts

Verify the decision

Maintenance and security

Full trust report
Maintenance
Active (28d since push)
As of Sep 20, 2026
Provenance
Not a fork · Organization account
As of Sep 20, 2026
Security (OSV)
16 low (16 low)
As of Jul 11, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

pip install WeaveBench
PyPI

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

WeaveBench benchmarks computer-use agents that integrate GUI and CLI interactions in real-world scenarios across various work domains.

Capability facts

CLI
CLI entrypoint

Source: pyproject.toml:[project.scripts] · Sep 20, 2026

Languages
python

Source: github.language+pyproject.toml · Sep 20, 2026

Categories

Tags

README

WeaveBench WeaveBench: A Long Horizon, Real World Benchmark for Computer Use Agents with Hybrid Interfaces <p align="center" <a href="https://2026.emnlp.org/" <img src="https://img.shields.io/badge/EMNLP 2026 Main Conference b5179e.svg?style=flat square" alt="EMNLP 2026 Main Conf...

For agents

This page has a .md twin and JSON over the API.

Was this helpful?

Anonymous feedback helps us improve pages and translations.