GraphCanon updated 2w · GitHub synced 2w
Decision brief
DevEval suits organizations requiring Python-centric software development benchmarks and practices evaluation.
Good fit when
- Choose DevEval when you require comprehensive benchmarking specifically for software development using Python.
- Use if your environment supports or prefers Docker, leveraging its offered secure and isolated setup.
Avoid when
- Avoid DevEval if your software projects heavily rely on languages other than Python.
- Do not use it when a non-Dockerized evaluation tool is preferred due to organizational constraints or preferences.
Observed Jul 16, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Dormant (797d since push)
- As of 2w
- Provenance
- Not a fork · Organization account
- As of 2w
- Security (OSV)
- No lockfile
- As of 1mo
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
pip install DevEval PyPISimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
Open-compass/DevEval focuses on benchmarking software development performance and practices using Python.
Capability facts
- Languages
- python
Source: github.language · Aug 5, 2026
Categories
Tags
README
🐳 Set Up with Docker
For a secure and isolated environment, we offer Docker support for DevBench. Please refer to our detailed Installation Guide.
📄 License
- Source Code Licensing: Our project's source code is licensed under the Apache 2.0 License. This license permits the use, modification, and distribution of the code, subject to certain conditions outlined in the Apache 2.0 License.
- Data Licensing: The related data utilized in our project is licensed under CC BY 4.0, which allows anyone to copy, distribute, transmit, adapt and make commercial use of the dataset.
For agents
This page has a .md twin and JSON over the API.