GraphCanon updated Oct 17, 2026 · GitHub synced Oct 17, 2026
Decision brief
Unverified catalog guidance: CommonGen-Eval is designed to evaluate large language models using the CommonGen-Lite dataset, focusing on generating diverse phrases and sentences.
Good fit when
- Unverified catalog guidance: Use CommonGen-Eval when you need to assess how well an LLM can generate a diverse set of common-sense facts or statements based on given concepts.
- Unverified catalog guidance: Select it specifically for testing text-generation capabilities aligned with everyday language understanding and generation.
Avoid when
- Unverified catalog guidance: Avoid using CommonGen-Eval if your evaluation priorities align more closely with task-specific benchmarks outside of general-language diversification.
- Unverified catalog guidance: Do not use this tool if your project requires an evaluation framework that focuses heavily on the ability to answer specific factual questions or handle domain-specific language.
- Requirements:
- Install Python dependencies using `pip install -r requirements.txt`; Download necessary Spacy models with `python -m spacy download en_core_web_lg`
Observed Jul 16, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Dormant (940d since push)
- As of Oct 17, 2026
- Provenance
- Not a fork · Organization account
- As of Oct 17, 2026
- Security (OSV)
- 94 low
- As of Jul 15, 2026
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
Package installation is not established from the available documentation. Check the source repository for setup instructions.
git clone https://github.com/allenai/commongen-evalSource repositorySimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
This tool evaluates large language models using the CommonGen-Lite dataset.
Capability facts
- MCP server
- Unknown; MCP server not established by this scan
Source: repo_scan · Oct 17, 2026
- Languages
- python
Source: github.language · Oct 17, 2026
Categories
Compatibility
Sourced claims from the README excerpt - not unsourced marketing copy.
Source: README excerpt (readme_declaration_v2, Oct 17, 2026)
pip install -r requirements.txtSource link
Tags
README
Installation
For agents
This page has a .md twin and JSON over the API.