GraphCanon
Home/Compare/code-eval vs autogen

Comparison

code-eval vs autogen

Verdict

Pick code-eval when license: code-eval is MIT, autogen is CC-BY-4.0; pick autogen when license: autogen is CC-BY-4.0, code-eval is MIT.

Markdown twin · code-eval alternatives · autogen alternatives

GraphCanon updated today

code-eval logo

code-eval

abacaj/code-eval

★ 429pushed Sep 12, 2023
vs
autogen logo

autogen

microsoft/autogen

★ 60kpushed Apr 15, 2026

Trust & integrity

Signalcode-evalautogen
Maintenance
Dormant (1033d since push)
As of today · github_public_v1
Steady (87d since push)
As of today · github_public_v1
Provenance
Not a fork · Personal account
As of today · github_public_v1
Not a fork · Organization account
As of today · github_public_v1
Security (OSV)
73 low (73 low)
As of today · osv@v1
No lockfile
As of today · none
code-eval trust reportautogen trust reportTrust methodology

Tagline

code-eval
Run evaluation on LLMs using human-eval benchmark
autogen
A programming framework for agentic AI

Stars

code-eval
429
autogen
60k

Forks

code-eval
37
autogen
9.0k

Open issues

code-eval
5
autogen
945

Language

code-eval
Python
autogen
Python

Adopt for

code-eval
-
autogen
AutoGen is a Python-based framework for developing and managing agentic AI systems. It includes the AutoGen Studio for no-code GUI setup, integrating with various models.

Persona

code-eval
-
autogen
-

Runtime

code-eval
-
autogen
-

License

code-eval
MIT
autogen
CC-BY-4.0

Last pushed

code-eval
Sep 12, 2023
autogen
Apr 15, 2026

Categories

code-eval
LLM Frameworks, Evaluation & Observability
autogen
AI Agents, LLM Frameworks

Trust and health

Maintenance

code-eval
Dormant (18%)
autogen
Steady (60%)

Days since push

code-eval
1033d
autogen
87d

Open issues (now)

code-eval
5
autogen
945

Owner type

code-eval
User
autogen
Organization

Security scan

code-eval
73 low (73 low)
autogen
No lockfile

Full report

code-eval
Trust report
autogen
Trust report

Shared compatibility

  • Python · code-eval: Python runtime · autogen: Python runtime

Choose code-eval if…

  • License: code-eval is MIT, autogen is CC-BY-4.0.
  • Tags unique to code-eval: wizardcoder, humaneval, python.
  • Also covers Evaluation & Observability.

When NOT to use code-eval

  • Last GitHub push was 1034 days ago (dormant maintenance, Sep 12, 2023). Validate activity before betting a new project on code-eval.
  • LLM Frameworks: Avoid a framework for a single prompt-and-retrieve call; the abstraction can cost more than it saves.
  • Evaluation & Observability: Defer heavyweight eval infra only until you have real traffic - never skip it once users depend on answers.
GitHubDetails

Choose autogen if…

  • License: autogen is CC-BY-4.0, code-eval is MIT.
  • Requirements: Min 4 GB RAM; AutoGen requires Python 3.10 or later.; Ensure security when connecting to MCP servers due to the potential for local command execution and sensitive information exposure..
  • Tags unique to autogen: llm-framework, autogen, agents, ai.
  • Also covers AI Agents.
  • You need a framework that supports integration with multiple AI models via OpenAI's chat completion client.

When NOT to use autogen

  • If you require tools supporting multiple programming languages beyond Python, as AutoGen is strictly a Python-based framework.
  • When deploying in environments where connecting to external servers (like those used by MCP) could pose security risks or is prohibited.
  • You need solutions which do not involve additional installations for server components such as `playwright/mcp`, as AutoGen requires this setup for certain functionalities.
GitHubDetails

Explore

code-eval trust report →autogen trust report →LLM Frameworks category →Evaluation & Observability category →AI Agents category →All comparisonsStack workflowsTrending tools

Sources

Every stat on this page traces to a dated GitHub sync, license file, enrichment field, or trust scan.

GitHub stars on cards: code-eval 429 · autogen 60k (synced Jul 11, 2026).

Common questions

What is the difference between code-eval and autogen?
code-eval: Run evaluation on LLMs using human-eval benchmark. autogen: A programming framework for agentic AI. See the comparison table for live GitHub stats and shared categories.
When should I choose code-eval over autogen?
Choose code-eval over autogen when License: code-eval is MIT, autogen is CC-BY-4.0; Tags unique to code-eval: wizardcoder, humaneval, python; Also covers Evaluation & Observability.
When should I choose autogen over code-eval?
Choose autogen over code-eval when License: autogen is CC-BY-4.0, code-eval is MIT; Requirements: Min 4 GB RAM; AutoGen requires Python 3.10 or later.; Ensure security when connecting to MCP servers due to the potential for local command execution and sensitive information exposure.; Tags unique to autogen: llm-framework, autogen, agents, ai; Also covers AI Agents; You need a framework that supports integration with multiple AI models via OpenAI's chat completion client.
When should I avoid code-eval?
Last GitHub push was 1034 days ago (dormant maintenance, Sep 12, 2023). Validate activity before betting a new project on code-eval. LLM Frameworks: Avoid a framework for a single prompt-and-retrieve call; the abstraction can cost more than it saves. Evaluation & Observability: Defer heavyweight eval infra only until you have real traffic - never skip it once users depend on answers.
When should I avoid autogen?
If you require tools supporting multiple programming languages beyond Python, as AutoGen is strictly a Python-based framework. When deploying in environments where connecting to external servers (like those used by MCP) could pose security risks or is prohibited. You need solutions which do not involve additional installations for server components such as playwright/mcp, as AutoGen requires this setup for certain functionalities.
Is code-eval or autogen more popular on GitHub?
autogen has more GitHub stars (59,658 vs 429). Stars measure visibility, not whether either tool fits your constraints.
Are code-eval and autogen open source?
Yes - both are open-source projects on GitHub (code-eval: MIT, autogen: CC-BY-4.0).
Where can I find alternatives to code-eval or autogen?
GraphCanon lists graph-backed alternatives at code-eval alternatives and autogen alternatives (code-eval markdown twin, autogen markdown twin), ranked by typed relationship edges rather than popularity votes.
Is there a machine-readable version of this comparison?
Yes. The markdown twin at this comparison mirrors this page for agents and LLM crawlers, with the same stats table and FAQ answers.
Which is better maintained, code-eval or autogen?
code-eval: Dormant. autogen: Steady. Compare maintenance labels, days since push, and release cadence in the trust section below - stars alone do not measure maintenance.
Where are the full trust reports for code-eval and autogen?
GraphCanon publishes per-repo trust reports with dated maintenance, provenance, and scan summaries: code-eval trust report; autogen trust report.