DevEval logo

DevEval

open-compass/DevEval

A Comprehensive Benchmark for Software Development

GraphCanon updated 2w · GitHub synced 2w

138 stars13 forksLast push 2y Python Apache-2.0

Decision brief

DevEval suits organizations requiring Python-centric software development benchmarks and practices evaluation.

Good fit when

  • Choose DevEval when you require comprehensive benchmarking specifically for software development using Python.
  • Use if your environment supports or prefers Docker, leveraging its offered secure and isolated setup.

Avoid when

  • Avoid DevEval if your software projects heavily rely on languages other than Python.
  • Do not use it when a non-Dockerized evaluation tool is preferred due to organizational constraints or preferences.

Observed Jul 16, 2026 · Source: enrich:decision_facts

Verify the decision

Maintenance and security

Full trust report
Maintenance
Dormant (797d since push)
As of 2w
Provenance
Not a fork · Organization account
As of 2w
Security (OSV)
No lockfile
As of 1mo

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

pip install DevEval
PyPI

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

Open-compass/DevEval focuses on benchmarking software development performance and practices using Python.

Capability facts

Languages
python

Source: github.language · Aug 5, 2026

Categories

Tags

README

🐳 Set Up with Docker

For a secure and isolated environment, we offer Docker support for DevBench. Please refer to our detailed Installation Guide.


📄 License

  • Source Code Licensing: Our project's source code is licensed under the Apache 2.0 License. This license permits the use, modification, and distribution of the code, subject to certain conditions outlined in the Apache 2.0 License.
  • Data Licensing: The related data utilized in our project is licensed under CC BY 4.0, which allows anyone to copy, distribute, transmit, adapt and make commercial use of the dataset.

For agents

This page has a .md twin and JSON over the API.

Was this helpful?

Anonymous feedback helps us improve pages and translations.