GraphCanon
Home/Model Training/human-eval
human-eval logo

human-eval

Enrichment pending
openai/human-eval

Code for the paper "Evaluating Large Language Models Trained on Code"

GitHub

GraphCanon updated today · GitHub synced today

3.3k
Stars
449
Forks
42
Open issues
120
Watchers
1y
Last push
Python MITCreated Jul 6, 2021

Trust & integrity

Full report
Maintenance
Dormant (540d since push)
As of today · Source: github_public_v1
Provenance
Not a fork · Organization account
As of today · Source: github_public_v1
Security (OSV)
No criticals
As of today · Source: osv@v1

Public GitHub metadata and optional OSV dependency scans. Signals, not a guarantee. Trust methodology.

Backing

Company and funding context for OpenAI. Display-only - not part of trust score or organic ranking.

Company
OpenAI·GitHub org profile·today
Employees
4,500·Wikidata (P1128 employees)·today
Funding
$13,000,000,000 (2023-01)·GraphCanon curated seed (public press)·today
Commercial model
OSS + managed cloud·GraphCanon curated seed·today

Overview

Code for the paper "Evaluating Large Language Models Trained on Code"

Capability facts

Languages
python

Source: github.language · Jul 11, 2026

Categories

Model TrainingLLM FrameworksEvaluation & Observability

Graph entities

OpenAIcompany

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Python runtimePython

Source: README excerpt (regex_v1, Jul 11, 2026)

Make sure to use python 3.7 or later:
Source link

Tags

python

README

Installation

Make sure to use python 3.7 or later:

$ conda create -n codex python=3.7
$ conda activate codex

Check out and install this repository:

$ git clone https://github.com/openai/human-eval
$ pip install -e human-eval