Home/LLM Frameworks/LiveCodeBench
LiveCodeBench logo

LiveCodeBench

Enrichment pending
LiveCodeBench/LiveCodeBench

Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"

GraphCanon updated today · GitHub synced today

904
Stars
193
Forks
35
Open issues
8
Watchers
12mo
Last push
Python MITCreated Mar 12, 2024

Trust & integrity

Full report
Maintenance
Slowing (360d since push)
As of today · Source: github_public_v1
Provenance
Not a fork · Organization account
As of today · Source: github_public_v1
Security (OSV)
No lockfile
As of today · Source: none

Public GitHub metadata and optional OSV dependency scans. Signals, not a guarantee. Trust methodology.

Overview

Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"

Capability facts

Languages
python

Source: github.language+pyproject.toml · Jul 11, 2026

Categories

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Python runtimePython

Source: README excerpt (regex_v1, Jul 11, 2026)

uv venv --python 3.11
Source link

Tags

README

Installation

You can clone the repository using the following command:

git clone https://github.com/LiveCodeBench/LiveCodeBench.git
cd LiveCodeBench

We recommend using uv for managing dependencies, which can be installed a number of ways.

Verify that uv is installed on your system by running:

uv --version

Once uv has been installed, use it to create a virtual environment for LiveCodeBench and install its dependencies with the following commands:

uv venv --python 3.11
source .venv/bin/activate

uv pip install -e .