DevEval logo

DevEval

open-compass/DevEval

A Comprehensive Benchmark for Software Development

GraphCanon updated Oct 8, 2026 · GitHub synced Oct 8, 2026

53views this month

138 stars13 forksLast push May 30, 2024 Python Apache-2.0

Decision brief

DevEval suits organizations requiring Python-centric software development benchmarks and practices evaluation.

Good fit when

  • Choose DevEval when you require comprehensive benchmarking specifically for software development using Python.
  • Use if your environment supports or prefers Docker, leveraging its offered secure and isolated setup.

Avoid when

  • Avoid DevEval if your software projects heavily rely on languages other than Python.
  • Do not use it when a non-Dockerized evaluation tool is preferred due to organizational constraints or preferences.

Observed Jul 16, 2026 · Source: enrich:decision_facts

Verify the decision

Maintenance and security

Full trust report
Maintenance
Dormant (860d since push)
As of Oct 8, 2026
Provenance
Not a fork · Organization account
As of Oct 8, 2026
Security (OSV)
No lockfile
As of Jul 11, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

pip install DevEval
PyPI

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

Open-compass/DevEval focuses on benchmarking software development performance and practices using Python.

Capability facts

Languages
python

Source: github.language · Oct 8, 2026

Categories

Tags

README

🐳 Set Up with Docker For a secure and isolated environment, we offer Docker support for DevBench. Please refer to our detailed Installation Guide. 📄 License Source Code Licensing: Our project's source code is licensed under the Apache 2.0 License. This license permits the use,...

For agents

This page has a .md twin and JSON over the API.

Was this helpful?

Anonymous feedback helps us improve pages and translations.