GraphCanon
Home/Compare/code-eval vs AstrBot

Comparison

code-eval vs AstrBot

Verdict

Pick code-eval when license: code-eval is MIT, AstrBot is AGPL-3.0; pick AstrBot when license: AstrBot is AGPL-3.0, code-eval is MIT.

Markdown twin · code-eval alternatives · AstrBot alternatives

GraphCanon updated today

code-eval logo

code-eval

abacaj/code-eval

★ 429pushed Sep 12, 2023
vs
AstrBot logo

AstrBot

AstrBotDevs/AstrBot

★ 36kpushed Jul 9, 2026

Trust & integrity

Signalcode-evalAstrBot
Maintenance
Dormant (1033d since push)
As of today · github_public_v1
Very active (2d since push)
As of today · github_public_v1
Provenance
Not a fork · Personal account
As of today · github_public_v1
Not a fork · Organization account
As of today · github_public_v1
Security (OSV)
73 low (73 low)
As of today · osv@v1
No MCP manifest
As of today · mcp_manifest
code-eval trust reportAstrBot trust reportTrust methodology

Tagline

code-eval
Run evaluation on LLMs using human-eval benchmark
AstrBot
AI Agent Assistant & development framework that integrates lots of IM platforms, LLMs, plugins and AI feature

Stars

code-eval
429
AstrBot
36k

Forks

code-eval
37
AstrBot
2.5k

Open issues

code-eval
5
AstrBot
1.3k

Language

code-eval
Python
AstrBot
Python

Adopt for

code-eval
-
AstrBot
AstrBot is an AI agent assistant and development framework that integrates multiple instant messaging platforms with various language models and plugins under the AGPL-3.0 license.

Persona

code-eval
-
AstrBot
-

Runtime

code-eval
-
AstrBot
-

License

code-eval
MIT
AstrBot
AGPL-3.0

Last pushed

code-eval
Sep 12, 2023
AstrBot
Jul 9, 2026

Categories

code-eval
LLM Frameworks, Evaluation & Observability
AstrBot
AI Agents, LLM Frameworks

Trust and health

Maintenance

code-eval
Dormant (18%)
AstrBot
Very active (96%)

Days since push

code-eval
1033d
AstrBot
2d

Open issues (now)

code-eval
5
AstrBot
1.3k

Owner type

code-eval
User
AstrBot
Organization

Security scan

code-eval
73 low (73 low)
AstrBot
No MCP manifest

Full report

code-eval
Trust report
AstrBot
Trust report

Choose code-eval if…

  • License: code-eval is MIT, AstrBot is AGPL-3.0.
  • Tags unique to code-eval: wizardcoder, humaneval, python.
  • Also covers Evaluation & Observability.

When NOT to use code-eval

  • Last GitHub push was 1034 days ago (dormant maintenance, Sep 12, 2023). Validate activity before betting a new project on code-eval.
  • LLM Frameworks: Avoid a framework for a single prompt-and-retrieve call; the abstraction can cost more than it saves.
  • Evaluation & Observability: Defer heavyweight eval infra only until you have real traffic - never skip it once users depend on answers.
GitHubDetails

Choose AstrBot if…

  • License: AstrBot is AGPL-3.0, code-eval is MIT.
  • Tags unique to AstrBot: ai, gemini, docker, discord.
  • Also covers AI Agents.
  • AstrBot ships Docker support for self-hosted deployment.
  • When you require a highly integrative environment where your AI agents can communicate across different instant messaging platforms like Discord, Telegram, QQ, and others.

When NOT to use AstrBot

  • If you are looking for proprietary solutions or do not want to comply with the AGPL-3.0 open-source license requirements, as AstrBot might not suit businesses preferring closed development.
  • In scenarios where a very streamlined or simple AI agent without extensive plugin and platform customizability is required due to time constraints or a specific project scope that does not need broad,
  • +adaptability.
GitHubDetails

Explore

code-eval trust report →AstrBot trust report →LLM Frameworks category →Evaluation & Observability category →AI Agents category →All comparisonsStack workflowsTrending tools

Sources

Every stat on this page traces to a dated GitHub sync, license file, enrichment field, or trust scan.

GitHub stars on cards: code-eval 429 · AstrBot 36k (synced Jul 11, 2026).

Common questions

What is the difference between code-eval and AstrBot?
code-eval: Run evaluation on LLMs using human-eval benchmark. AstrBot: AI Agent Assistant & development framework that integrates lots of IM platforms, LLMs, plugins and AI feature. See the comparison table for live GitHub stats and shared categories.
When should I choose code-eval over AstrBot?
Choose code-eval over AstrBot when License: code-eval is MIT, AstrBot is AGPL-3.0; Tags unique to code-eval: wizardcoder, humaneval, python; Also covers Evaluation & Observability.
When should I choose AstrBot over code-eval?
Choose AstrBot over code-eval when License: AstrBot is AGPL-3.0, code-eval is MIT; Tags unique to AstrBot: ai, gemini, docker, discord; Also covers AI Agents; AstrBot ships Docker support for self-hosted deployment; When you require a highly integrative environment where your AI agents can communicate across different instant messaging platforms like Discord, Telegram, QQ, and others.
When should I avoid code-eval?
Last GitHub push was 1034 days ago (dormant maintenance, Sep 12, 2023). Validate activity before betting a new project on code-eval. LLM Frameworks: Avoid a framework for a single prompt-and-retrieve call; the abstraction can cost more than it saves. Evaluation & Observability: Defer heavyweight eval infra only until you have real traffic - never skip it once users depend on answers.
When should I avoid AstrBot?
If you are looking for proprietary solutions or do not want to comply with the AGPL-3.0 open-source license requirements, as AstrBot might not suit businesses preferring closed development. In scenarios where a very streamlined or simple AI agent without extensive plugin and platform customizability is required due to time constraints or a specific project scope that does not need broad, +adaptability.
Is code-eval or AstrBot more popular on GitHub?
AstrBot has more GitHub stars (36,186 vs 429). Stars measure visibility, not whether either tool fits your constraints.
Are code-eval and AstrBot open source?
Yes - both are open-source projects on GitHub (code-eval: MIT, AstrBot: AGPL-3.0).
Where can I find alternatives to code-eval or AstrBot?
GraphCanon lists graph-backed alternatives at code-eval alternatives and AstrBot alternatives (code-eval markdown twin, AstrBot markdown twin), ranked by typed relationship edges rather than popularity votes.
Is there a machine-readable version of this comparison?
Yes. The markdown twin at this comparison mirrors this page for agents and LLM crawlers, with the same stats table and FAQ answers.
Which is better maintained, code-eval or AstrBot?
code-eval: Dormant. AstrBot: Very active. Compare maintenance labels, days since push, and release cadence in the trust section below - stars alone do not measure maintenance.
Where are the full trust reports for code-eval and AstrBot?
GraphCanon publishes per-repo trust reports with dated maintenance, provenance, and scan summaries: code-eval trust report; AstrBot trust report.