Home/Compare/GSM-IC vs academic-research-skills-codex

Comparison

GSM-IC vs academic-research-skills-codex

Verdict

Pick GSM-IC if gSM-IC is a benchmark dataset that evaluates the distractibility of language models by introducing irrelevant context into grade-school math problems; pick academic-research-skills-codex if codex-native tools designed to streamline academic research processes through human-in-the-loop workflows. Written in Python and useful for tasks ranging from literature review to publication support.

Markdown twin · GSM-IC alternatives · academic-research-skills-codex alternatives

GraphCanon updated Sep 20, 2026

GSM-IC logo

GSM-IC

google-research-datasets/GSM-IC

★ 67pushed Feb 13, 2023
vs
academic-research-skills-codex logo

academic-research-skills-codex

Imbad0202/academic-research-skills-codex

★ 11kpushed Sep 16, 2026

Trust & integrity

SignalGSM-ICacademic-research-skills-codex
Maintenance
Archived (1312d since push)
As of Sep 18, 2026 · github_public_v1
Very active (4d since push)
As of Sep 20, 2026 · github_public_v1
Provenance
Not a fork · Organization account
As of Sep 18, 2026 · github_public_v1
Not a fork · Personal account
As of Sep 20, 2026 · github_public_v1
OSV dependency advisories
No lockfile (source not queried)
As of Sep 18, 2026 · osv@v1
No lockfile (source not queried)
As of Jul 11, 2026 · osv@v1
deps.dev advisories
Not queried
deps.dev@v1
Not queried
deps.dev@v1
OpenSSF Scorecard
Not queried
openssf-scorecard@v1
Not queried
openssf-scorecard@v1

Tagline

GSM-IC
GSM-IC benchmark evaluates distractibility of language models with grade-school math problems and irrelevant context.
academic-research-skills-codex
Codex-native Academic Research Skills suite for human-in-the-loop academic research workflows

Stars

GSM-IC
67
academic-research-skills-codex
11k

Forks

GSM-IC
2
academic-research-skills-codex
488

Open issues

GSM-IC
1
academic-research-skills-codex
0

Language

GSM-IC
-
academic-research-skills-codex
Python

Adopt for

GSM-IC
GSM-IC is a benchmark dataset that evaluates the distractibility of language models by introducing irrelevant context into grade-school math problems.
academic-research-skills-codex
Codex-native tools designed to streamline academic research processes through human-in-the-loop workflows. Written in Python and useful for tasks ranging from literature review to publication support.

Persona

GSM-IC
-
academic-research-skills-codex
-

Runtime

GSM-IC
-
academic-research-skills-codex
-

License

GSM-IC
License information is not provided in the repository.
academic-research-skills-codex
Other

Last pushed

GSM-IC
Feb 13, 2023
academic-research-skills-codex
Sep 16, 2026

Categories

GSM-IC
Evaluation & Observability
academic-research-skills-codex
Developer Tools, Evaluation & Observability

Trust and health

Maintenance

GSM-IC
Archived (8%)
academic-research-skills-codex
Very active (96%)

Days since push

GSM-IC
1312d
academic-research-skills-codex
4d

Archived on GitHub

GSM-IC
Yes
academic-research-skills-codex
No

Open issues (now)

GSM-IC
1
academic-research-skills-codex
0

Stars delta

GSM-IC
0 (30d)
academic-research-skills-codex
+4.1k (30d)

Open issues delta

GSM-IC
0 (30d)
academic-research-skills-codex
-2 (30d)

Owner type

GSM-IC
Organization
academic-research-skills-codex
User

Full report

academic-research-skills-codex
Trust report

Choose GSM-IC if…

  • Pricing: Pricing details are not available..
  • Requirements: The dataset is derived from GSM8K and includes irrelevant context in problem descriptions to test the distractibility of language models..
  • Tags unique to GSM-IC: arithmetic reasoning, benchmark, distractibility, grade-school math.
  • Use GSM-IC when you need to assess how well a language model can focus on relevant information in arithmetic reasoning tasks, especially when faced with distracting irrelevant context.

When NOT to use GSM-IC

  • Avoid GSM-IC if your evaluation focuses on the model's ability to solve math problems without any form of distraction or if the context is always assumed to be relevant.
  • Do not use GSM-IC if your primary interest is in evaluating the model's performance on pure arithmetic tasks without the added complexity of irrelevant context.

Choose academic-research-skills-codex if…

  • Tags unique to academic-research-skills-codex: academic-pipeline, academic-research, academic-writing, ai research.
  • Also covers Developer Tools.
  • When your research involves heavy use of Codex technology, as this toolset is natively built around it, optimizing its functionalities.

When NOT to use academic-research-skills-codex

  • If you are working in an environment where proprietary software tools are mandated and Python-based solutions are not acceptable or compliant.
  • When your research tasks do not require integration with Codex technology; using this toolset would add unnecessary complexity and learning curve if Codex is not part of your workflow.

Explore

Sources

Every stat on this page traces to a dated GitHub sync, license file, enrichment field, or trust scan.

GitHub stars on cards: GSM-IC 67 · academic-research-skills-codex 11k (synced Sep 20, 2026).

Common questions

What is the difference between GSM-IC and academic-research-skills-codex?
GSM-IC: GSM-IC benchmark evaluates distractibility of language models with grade-school math problems and irrelevant context.. academic-research-skills-codex: Codex-native Academic Research Skills suite for human-in-the-loop academic research workflows. See the comparison table for live GitHub stats and shared categories.
When should I choose GSM-IC over academic-research-skills-codex?
Choose GSM-IC over academic-research-skills-codex when Pricing: Pricing details are not available.; Requirements: The dataset is derived from GSM8K and includes irrelevant context in problem descriptions to test the distractibility of language models.; Tags unique to GSM-IC: arithmetic reasoning, benchmark, distractibility, grade-school math; Use GSM-IC when you need to assess how well a language model can focus on relevant information in arithmetic reasoning tasks, especially when faced with distracting irrelevant context.
When should I choose academic-research-skills-codex over GSM-IC?
Choose academic-research-skills-codex over GSM-IC when Tags unique to academic-research-skills-codex: academic-pipeline, academic-research, academic-writing, ai research; Also covers Developer Tools; When your research involves heavy use of Codex technology, as this toolset is natively built around it, optimizing its functionalities.
When should I avoid GSM-IC?
Avoid GSM-IC if your evaluation focuses on the model's ability to solve math problems without any form of distraction or if the context is always assumed to be relevant. Do not use GSM-IC if your primary interest is in evaluating the model's performance on pure arithmetic tasks without the added complexity of irrelevant context.
When should I avoid academic-research-skills-codex?
If you are working in an environment where proprietary software tools are mandated and Python-based solutions are not acceptable or compliant. When your research tasks do not require integration with Codex technology; using this toolset would add unnecessary complexity and learning curve if Codex is not part of your workflow.
Is GSM-IC or academic-research-skills-codex more popular on GitHub?
academic-research-skills-codex has more GitHub stars (11,256 vs 67). Stars measure visibility, not whether either tool fits your constraints.
Are GSM-IC and academic-research-skills-codex open source?
Yes - both are open-source projects on GitHub.
Where can I find alternatives to GSM-IC or academic-research-skills-codex?
GraphCanon lists graph-backed alternatives at GSM-IC alternatives and academic-research-skills-codex alternatives (GSM-IC markdown twin, academic-research-skills-codex markdown twin), ranked by typed relationship edges rather than popularity votes.
Is there a machine-readable version of this comparison?
Yes. The markdown twin at this comparison mirrors this page for agents and LLM crawlers, with the same stats table and FAQ answers.
Which is better maintained, GSM-IC or academic-research-skills-codex?
GSM-IC: Archived. academic-research-skills-codex: Very active. Compare maintenance labels, days since push, and release cadence in the trust section below - stars alone do not measure maintenance.
Where are the full trust reports for GSM-IC and academic-research-skills-codex?
GraphCanon publishes per-repo trust reports with dated maintenance, provenance, and scan summaries: GSM-IC trust report; academic-research-skills-codex trust report.

Was this helpful?

Anonymous feedback helps us improve pages and translations.