GraphCanon
Home/Compare/GSM-IC vs autogen

Comparison

GSM-IC vs autogen

Verdict

Pick GSM-IC when also covers Evaluation & Observability; pick autogen when requirements: Min 4 GB RAM; AutoGen requires Python 3.10 or later.; Ensure security when connecting to MCP servers due to the potential for local command execution and sensitive information exposure..

Markdown twin · GSM-IC alternatives · autogen alternatives

GraphCanon updated today

GSM-IC logo

GSM-IC

google-research-datasets/GSM-IC

★ 67pushed Feb 13, 2023
vs
autogen logo

autogen

microsoft/autogen

★ 60kpushed Apr 15, 2026

Trust & integrity

SignalGSM-ICautogen
Maintenance
Archived (1244d since push)
As of today · github_public_v1
Steady (87d since push)
As of today · github_public_v1
Provenance
Not a fork · Organization account
As of today · github_public_v1
Not a fork · Organization account
As of today · github_public_v1
Security (OSV)
No lockfile
As of today · none
No lockfile
As of 1d · none
GSM-IC trust reportautogen trust reportTrust methodology

Tagline

GSM-IC
Grade-School Math with Irrelevant Context (GSM-IC) benchmark is an arithmetic reasoning dataset built upon GSM8K, by adding irrelevant sentences in problem descriptions. GSM-IC is constructed to evalu
autogen
A programming framework for agentic AI

Stars

GSM-IC
67
autogen
60k

Forks

GSM-IC
2
autogen
9.0k

Open issues

GSM-IC
1
autogen
945

Language

GSM-IC
-
autogen
Python

Adopt for

GSM-IC
-
autogen
AutoGen is a Python-based framework for developing and managing agentic AI systems. It includes the AutoGen Studio for no-code GUI setup, integrating with various models.

Persona

GSM-IC
-
autogen
-

Runtime

GSM-IC
-
autogen
-

License

GSM-IC
-
autogen
CC-BY-4.0

Last pushed

GSM-IC
Feb 13, 2023
autogen
Apr 15, 2026

Categories

GSM-IC
Evaluation & Observability, LLM Frameworks
autogen
AI Agents, LLM Frameworks

Trust and health

Maintenance

GSM-IC
Archived (8%)
autogen
Steady (60%)

Days since push

GSM-IC
1244d
autogen
87d

Archived on GitHub

GSM-IC
Yes
autogen
No

Open issues (now)

GSM-IC
1
autogen
945

Full report

GSM-IC
Trust report
autogen
Trust report

Choose GSM-IC if…

  • Also covers Evaluation & Observability.
  • Leaner open-issue backlog (1).

When NOT to use GSM-IC

  • GSM-IC is archived on GitHub. Prefer an active alternative unless you maintain a private fork or need a frozen dependency.
  • Evaluation & Observability: Defer heavyweight eval infra only until you have real traffic - never skip it once users depend on answers.
  • LLM Frameworks: Avoid a framework for a single prompt-and-retrieve call; the abstraction can cost more than it saves.
GitHubDetails

Choose autogen if…

  • Requirements: Min 4 GB RAM; AutoGen requires Python 3.10 or later.; Ensure security when connecting to MCP servers due to the potential for local command execution and sensitive information exposure..
  • Tags unique to autogen: agentic-agi, agents, ai, autogen.
  • Also covers AI Agents.
  • You need a framework that supports integration with multiple AI models via OpenAI's chat completion client.

When NOT to use autogen

  • If you require tools supporting multiple programming languages beyond Python, as AutoGen is strictly a Python-based framework.
  • When deploying in environments where connecting to external servers (like those used by MCP) could pose security risks or is prohibited.
  • You need solutions which do not involve additional installations for server components such as `playwright/mcp`, as AutoGen requires this setup for certain functionalities.
GitHubDetails

Explore

GSM-IC trust report →autogen trust report →Evaluation & Observability category →LLM Frameworks category →AI Agents category →All comparisonsStack workflowsTrending tools

Sources

Every stat on this page traces to a dated GitHub sync, license file, enrichment field, or trust scan.

GitHub stars on cards: GSM-IC 67 · autogen 60k (synced Jul 11, 2026).

Common questions

What is the difference between GSM-IC and autogen?
GSM-IC: Grade-School Math with Irrelevant Context (GSM-IC) benchmark is an arithmetic reasoning dataset built upon GSM8K, by adding irrelevant sentences in problem descriptions. GSM-IC is constructed to evalu. autogen: A programming framework for agentic AI. See the comparison table for live GitHub stats and shared categories.
When should I choose GSM-IC over autogen?
Choose GSM-IC over autogen when Also covers Evaluation & Observability; Leaner open-issue backlog (1).
When should I choose autogen over GSM-IC?
Choose autogen over GSM-IC when Requirements: Min 4 GB RAM; AutoGen requires Python 3.10 or later.; Ensure security when connecting to MCP servers due to the potential for local command execution and sensitive information exposure.; Tags unique to autogen: agentic-agi, agents, ai, autogen; Also covers AI Agents; You need a framework that supports integration with multiple AI models via OpenAI's chat completion client.
When should I avoid GSM-IC?
GSM-IC is archived on GitHub. Prefer an active alternative unless you maintain a private fork or need a frozen dependency. Evaluation & Observability: Defer heavyweight eval infra only until you have real traffic - never skip it once users depend on answers. LLM Frameworks: Avoid a framework for a single prompt-and-retrieve call; the abstraction can cost more than it saves.
When should I avoid autogen?
If you require tools supporting multiple programming languages beyond Python, as AutoGen is strictly a Python-based framework. When deploying in environments where connecting to external servers (like those used by MCP) could pose security risks or is prohibited. You need solutions which do not involve additional installations for server components such as playwright/mcp, as AutoGen requires this setup for certain functionalities.
Is GSM-IC or autogen more popular on GitHub?
autogen has more GitHub stars (59,658 vs 67). Stars measure visibility, not whether either tool fits your constraints.
Are GSM-IC and autogen open source?
Yes - both are open-source projects on GitHub.
Where can I find alternatives to GSM-IC or autogen?
GraphCanon lists graph-backed alternatives at GSM-IC alternatives and autogen alternatives (GSM-IC markdown twin, autogen markdown twin), ranked by typed relationship edges rather than popularity votes.
Is there a machine-readable version of this comparison?
Yes. The markdown twin at this comparison mirrors this page for agents and LLM crawlers, with the same stats table and FAQ answers.
Which is better maintained, GSM-IC or autogen?
GSM-IC: Archived. autogen: Steady. Compare maintenance labels, days since push, and release cadence in the trust section below - stars alone do not measure maintenance.
Where are the full trust reports for GSM-IC and autogen?
GraphCanon publishes per-repo trust reports with dated maintenance, provenance, and scan summaries: GSM-IC trust report; autogen trust report.