GraphCanon
Home/Data & Retrieval/cceval
cceval logo

cceval

Enrichment pending
amazon-science/cceval

CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)

GitHub Website

GraphCanon updated today · GitHub synced today

181
Stars
25
Forks
5
Open issues
5
Watchers
11mo
Last push
Python Apache-2.0Created Oct 16, 2023

Trust & integrity

Full report
Maintenance
Slowing (330d since push)
As of today · Source: github_public_v1
Provenance
Not a fork · Organization account
As of today · Source: github_public_v1
Security (OSV)
5 critical, 7 high, 8 medium, 21 low (5 critical, 7 high, 8 medium, 21 low)
As of today · Source: osv@v1

Public GitHub metadata and optional OSV dependency scans. Signals, not a guarantee. Trust methodology.

Overview

CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)

Capability facts

Languages
python

Source: github.language · Jul 11, 2026

Categories

Data & RetrievalEvaluation & Observability

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Python runtimePython

Source: README excerpt (regex_v1, Jul 11, 2026)

- Install dependencies via `pip install -r requirements.txt`
Source link

Tags

python

README

Requirements

  • Uncompress the CrossCodeEval data via tar -xvJf data/crosscodeeval_data.tar.xz -C data/
    • The data contains {baseline, retrieval, retrieval w/ ref.} setting x {bm25, UniXCoder, OpenAI Ada} retriever.
    • Please email us if you need the raw data.
  • Install dependencies via pip install -r requirements.txt
  • Build tree sitter via bash scripts/build_treesitter.sh

License

This project is licensed under the Apache-2.0 License.