Home/Compare/code-eval vs FastChat

Comparison

code-eval vs FastChat

Verdict

Pick code-eval when license: code-eval is MIT, FastChat is Apache-2.0; pick FastChat when license: FastChat is Apache-2.0, code-eval is MIT.

Markdown twin · code-eval alternatives · FastChat alternatives

GraphCanon updated today

code-eval logo

code-eval

abacaj/code-eval

429pushed Sep 12, 2023
vs
FastChat logo

FastChat

lm-sys/FastChat

39kpushed May 1, 2026

Trust & integrity

Signalcode-evalFastChat
Maintenance
Dormant (1033d since push)
As of today · github_public_v1
Steady (71d since push)
As of today · github_public_v1
Provenance
Not a fork · Personal account
As of today · github_public_v1
Not a fork · Organization account
As of today · github_public_v1
Security (OSV)
73 low (73 low)
As of today · osv@v1
No lockfile
As of today · none

Tagline

code-eval
Run evaluation on LLMs using human-eval benchmark
FastChat
An open platform for training, serving, and evaluating large language models

Stars

code-eval
429
FastChat
39k

Forks

code-eval
37
FastChat
4.8k

Open issues

code-eval
5
FastChat
1.0k

Language

code-eval
Python
FastChat
Python

Adopt for

code-eval
-
FastChat
FastChat is a comprehensive open platform for managing large language models (LLMs) that includes capabilities for training, serving, evaluating, and comparing chatbot models via web UIs and RESTful APIs. It powers ChatB

Persona

code-eval
-
FastChat
-

Runtime

code-eval
-
FastChat
-

License

code-eval
MIT
FastChat
Apache-2.0

Last pushed

code-eval
Sep 12, 2023
FastChat
May 1, 2026

Categories

code-eval
LLM Frameworks, Evaluation & Observability
FastChat
Model Training, LLM Frameworks, Inference & Serving, Evaluation & Observability

Trust and health

Maintenance

code-eval
Dormant (18%)
FastChat
Steady (60%)

Days since push

code-eval
1033d
FastChat
71d

Open issues (now)

code-eval
5
FastChat
1.0k

Owner type

code-eval
User
FastChat
Organization

Security scan

code-eval
73 low (73 low)
FastChat
No lockfile

Full report

code-eval
Trust report
FastChat
Trust report

Shared compatibility

  • Python · code-eval: Python runtime · FastChat: Python runtime

Choose code-eval if…

  • License: code-eval is MIT, FastChat is Apache-2.0.
  • Tags unique to code-eval: wizardcoder, humaneval, python.
  • Leaner open-issue backlog (5).

When NOT to use code-eval

  • Last GitHub push was 1034 days ago (dormant maintenance, Sep 12, 2023). Validate activity before betting a new project on code-eval.
  • LLM Frameworks: Avoid a framework for a single prompt-and-retrieve call; the abstraction can cost more than it saves.
  • Evaluation & Observability: Defer heavyweight eval infra only until you have real traffic - never skip it once users depend on answers.

Choose FastChat if…

  • License: FastChat is Apache-2.0, code-eval is MIT.
  • Tags unique to FastChat: evaluation system, large-language-models, chatbots, distributed serving.
  • Also covers Model Training, Inference & Serving.
  • - You are looking to train and evaluate state-of-the-art models such as Vicuna or MT-Bench.

When NOT to use FastChat

  • - You require a proprietary or closed-source framework; FastChat is open-source under Apache-2.0 license and its use might be unsuitable for environments requiring proprietary solutions.
  • - Your chatbot evaluation needs do not align with the types of data used in FastChat's datasets (e.g., human votes, MT-Bench evaluations).
  • - You prefer a more user-friendly setup without the need to clone a repository and manually install dependencies; FastChat requires installation from source with additional steps for Rust and CMake on
  • + Mac.

Explore

Sources

Every stat on this page traces to a dated GitHub sync, license file, enrichment field, or trust scan.

GitHub stars on cards: code-eval 429 · FastChat 39k (synced Jul 11, 2026).

Common questions

What is the difference between code-eval and FastChat?
code-eval: Run evaluation on LLMs using human-eval benchmark. FastChat: An open platform for training, serving, and evaluating large language models. See the comparison table for live GitHub stats and shared categories.
When should I choose code-eval over FastChat?
Choose code-eval over FastChat when License: code-eval is MIT, FastChat is Apache-2.0; Tags unique to code-eval: wizardcoder, humaneval, python; Leaner open-issue backlog (5).
When should I choose FastChat over code-eval?
Choose FastChat over code-eval when License: FastChat is Apache-2.0, code-eval is MIT; Tags unique to FastChat: evaluation system, large-language-models, chatbots, distributed serving; Also covers Model Training, Inference & Serving; - You are looking to train and evaluate state-of-the-art models such as Vicuna or MT-Bench.
When should I avoid code-eval?
Last GitHub push was 1034 days ago (dormant maintenance, Sep 12, 2023). Validate activity before betting a new project on code-eval. LLM Frameworks: Avoid a framework for a single prompt-and-retrieve call; the abstraction can cost more than it saves. Evaluation & Observability: Defer heavyweight eval infra only until you have real traffic - never skip it once users depend on answers.
When should I avoid FastChat?
- You require a proprietary or closed-source framework; FastChat is open-source under Apache-2.0 license and its use might be unsuitable for environments requiring proprietary solutions. - Your chatbot evaluation needs do not align with the types of data used in FastChat's datasets (e.g., human votes, MT-Bench evaluations). - You prefer a more user-friendly setup without the need to clone a repository and manually install dependencies; FastChat requires installation from source with additional steps for Rust and CMake on + Mac.
Is code-eval or FastChat more popular on GitHub?
FastChat has more GitHub stars (39,490 vs 429). Stars measure visibility, not whether either tool fits your constraints.
Are code-eval and FastChat open source?
Yes - both are open-source projects on GitHub (code-eval: MIT, FastChat: Apache-2.0).
Where can I find alternatives to code-eval or FastChat?
GraphCanon lists graph-backed alternatives at code-eval alternatives and FastChat alternatives (code-eval markdown twin, FastChat markdown twin), ranked by typed relationship edges rather than popularity votes.
Is there a machine-readable version of this comparison?
Yes. The markdown twin at this comparison mirrors this page for agents and LLM crawlers, with the same stats table and FAQ answers.
Which is better maintained, code-eval or FastChat?
code-eval: Dormant. FastChat: Steady. Compare maintenance labels, days since push, and release cadence in the trust section below - stars alone do not measure maintenance.
Where are the full trust reports for code-eval and FastChat?
GraphCanon publishes per-repo trust reports with dated maintenance, provenance, and scan summaries: code-eval trust report; FastChat trust report.