--- title: "GSM-IC vs academic-research-skills-codex" type: "comparison" canonical_url: "https://www.graphcanon.com/compare/google-research-datasets-gsm-ic-vs-imbad0202-academic-research-skills-codex" tools: ["google-research-datasets-gsm-ic", "imbad0202-academic-research-skills-codex"] --- # GSM-IC vs academic-research-skills-codex *GraphCanon updated Sep 20, 2026* ## Verdict Pick GSM-IC if gSM-IC is a benchmark dataset that evaluates the distractibility of language models by introducing irrelevant context into grade-school math problems; pick academic-research-skills-codex if codex-native tools designed to streamline academic research processes through human-in-the-loop workflows. Written in Python and useful for tasks ranging from literature review to publication support. [GSM-IC](https://github.com/google-research-datasets/GSM-IC) reports 67 GitHub stars, 2 forks, and 1 open issues, last pushed Feb 13, 2023. [academic-research-skills-codex](https://github.com/Imbad0202/academic-research-skills) has 11k stars, 488 forks, and 0 open issues, last pushed Sep 16, 2026. Figures are from public GitHub metadata via [GSM-IC's repository](https://github.com/google-research-datasets/GSM-IC) and [academic-research-skills-codex's repository](https://github.com/Imbad0202/academic-research-skills-codex). | | [GSM-IC](/tools/google-research-datasets-gsm-ic.md) | [academic-research-skills-codex](/tools/imbad0202-academic-research-skills-codex.md) | | --- | --- | --- | | Tagline | GSM-IC benchmark evaluates distractibility of language models with grade-school math problems and irrelevant context. | Codex-native Academic Research Skills suite for human-in-the-loop academic research workflows | | Stars | 67 | 11,256 | | Forks | 2 | 488 | | Open issues | 1 | 0 | | Language | - | Python | | Adopt for | GSM-IC is a benchmark dataset that evaluates the distractibility of language models by introducing irrelevant context into grade-school math problems. | Codex-native tools designed to streamline academic research processes through human-in-the-loop workflows. Written in Python and useful for tasks ranging from literature review to publication support. | | Persona | - | - | | Runtime | - | - | | License | License information is not provided in the repository. | Other | | Categories | Evaluation & Observability | Developer Tools, Evaluation & Observability | ## Trust and health _Sourced signals - not a safety guarantee. No winner column._ | | [GSM-IC](/tools/google-research-datasets-gsm-ic.md) | [academic-research-skills-codex](/tools/imbad0202-academic-research-skills-codex.md) | | --- | --- | --- | | Maintenance | Archived (8%) | Very active (96%) | | Days since push | 1312d | 4d | | Archived on GitHub | Yes | No | | Open issues (now) | 1 | 0 | | Stars delta | 0 (30d) | +4.1k (30d) | | Open issues delta | 0 (30d) | -2 (30d) | | Owner type | Organization | User | | Full report | [trust report](/tools/google-research-datasets-gsm-ic/trust.md) | [trust report](/tools/imbad0202-academic-research-skills-codex/trust.md) | ## Decision facts: GSM-IC - **Pricing:** unknown - Pricing details are not available. - **Requirements:** The dataset is derived from GSM8K and includes irrelevant context in problem descriptions to test the distractibility of language models. - **Adopt for:** GSM-IC is a benchmark dataset that evaluates the distractibility of language models by introducing irrelevant context into grade-school math problems. - **License detail:** License information is not provided in the repository. ## Decision facts: academic-research-skills-codex - **Adopt for:** Codex-native tools designed to streamline academic research processes through human-in-the-loop workflows. Written in Python and useful for tasks ranging from literature review to publication support. ## Choose when ### Choose GSM-IC if… - Pricing: Pricing details are not available.. - Requirements: The dataset is derived from GSM8K and includes irrelevant context in problem descriptions to test the distractibility of language models.. - Tags unique to GSM-IC: arithmetic reasoning, benchmark, distractibility, grade-school math. - Use GSM-IC when you need to assess how well a language model can focus on relevant information in arithmetic reasoning tasks, especially when faced with distracting irrelevant context. ### Choose academic-research-skills-codex if… - Tags unique to academic-research-skills-codex: academic-pipeline, academic-research, academic-writing, ai research. - Also covers Developer Tools. - When your research involves heavy use of Codex technology, as this toolset is natively built around it, optimizing its functionalities. ## When NOT to use GSM-IC - Avoid GSM-IC if your evaluation focuses on the model's ability to solve math problems without any form of distraction or if the context is always assumed to be relevant. - Do not use GSM-IC if your primary interest is in evaluating the model's performance on pure arithmetic tasks without the added complexity of irrelevant context. ## When NOT to use academic-research-skills-codex - If you are working in an environment where proprietary software tools are mandated and Python-based solutions are not acceptable or compliant. - When your research tasks do not require integration with Codex technology; using this toolset would add unnecessary complexity and learning curve if Codex is not part of your workflow. ## Common questions ### What is the difference between GSM-IC and academic-research-skills-codex? GSM-IC: GSM-IC benchmark evaluates distractibility of language models with grade-school math problems and irrelevant context.. academic-research-skills-codex: Codex-native Academic Research Skills suite for human-in-the-loop academic research workflows. See the comparison table for live GitHub stats and shared categories. ### When should I choose GSM-IC over academic-research-skills-codex? Choose GSM-IC over academic-research-skills-codex when Pricing: Pricing details are not available.; Requirements: The dataset is derived from GSM8K and includes irrelevant context in problem descriptions to test the distractibility of language models.; Tags unique to GSM-IC: arithmetic reasoning, benchmark, distractibility, grade-school math; Use GSM-IC when you need to assess how well a language model can focus on relevant information in arithmetic reasoning tasks, especially when faced with distracting irrelevant context. ### When should I choose academic-research-skills-codex over GSM-IC? Choose academic-research-skills-codex over GSM-IC when Tags unique to academic-research-skills-codex: academic-pipeline, academic-research, academic-writing, ai research; Also covers Developer Tools; When your research involves heavy use of Codex technology, as this toolset is natively built around it, optimizing its functionalities. ### When should I avoid GSM-IC? Avoid GSM-IC if your evaluation focuses on the model's ability to solve math problems without any form of distraction or if the context is always assumed to be relevant. Do not use GSM-IC if your primary interest is in evaluating the model's performance on pure arithmetic tasks without the added complexity of irrelevant context. ### When should I avoid academic-research-skills-codex? If you are working in an environment where proprietary software tools are mandated and Python-based solutions are not acceptable or compliant. When your research tasks do not require integration with Codex technology; using this toolset would add unnecessary complexity and learning curve if Codex is not part of your workflow. ### Is GSM-IC or academic-research-skills-codex more popular on GitHub? academic-research-skills-codex has more GitHub stars (11,256 vs 67). Stars measure visibility, not whether either tool fits your constraints. ### Are GSM-IC and academic-research-skills-codex open source? Yes - both are open-source projects on GitHub. ### Where can I find alternatives to GSM-IC or academic-research-skills-codex? GraphCanon lists graph-backed alternatives at [GSM-IC alternatives](/tools/google-research-datasets-gsm-ic/alternatives) and [academic-research-skills-codex alternatives](/tools/imbad0202-academic-research-skills-codex/alternatives) ([GSM-IC markdown twin](/tools/google-research-datasets-gsm-ic/alternatives.md), [academic-research-skills-codex markdown twin](/tools/imbad0202-academic-research-skills-codex/alternatives.md)), ranked by typed relationship edges rather than popularity votes. ### Is there a machine-readable version of this comparison? Yes. The markdown twin at [this comparison](/compare/google-research-datasets-gsm-ic-vs-imbad0202-academic-research-skills-codex.md) mirrors this page for agents and LLM crawlers, with the same stats table and FAQ answers. ### Which is better maintained, GSM-IC or academic-research-skills-codex? GSM-IC: Archived. academic-research-skills-codex: Very active. Compare maintenance labels, days since push, and release cadence in the trust section below - stars alone do not measure maintenance. ### Where are the full trust reports for GSM-IC and academic-research-skills-codex? GraphCanon publishes per-repo trust reports with dated maintenance, provenance, and scan summaries: [GSM-IC trust report](/tools/google-research-datasets-gsm-ic/trust); [academic-research-skills-codex trust report](/tools/imbad0202-academic-research-skills-codex/trust). --- **Machine-readable endpoints** - JSON: [`/api/graphcanon/graph?tool=google-research-datasets-gsm-ic`](/api/graphcanon/graph?tool=google-research-datasets-gsm-ic) - LLM index: [/llms.txt](/llms.txt) - Full corpus: [/llms-full.txt](/llms-full.txt) _GraphCanon - The knowledge graph for AI development. https://www.graphcanon.com/_