--- title: "Awesome-Multimodal-Large-Language-Models vs GSM-IC" type: "comparison" canonical_url: "https://www.graphcanon.com/compare/bradyfu-awesome-multimodal-large-language-models-vs-google-research-datasets-gsm-ic" tools: ["bradyfu-awesome-multimodal-large-language-models", "google-research-datasets-gsm-ic"] --- # Awesome-Multimodal-Large-Language-Models vs GSM-IC *GraphCanon updated Sep 20, 2026* ## Verdict Pick Awesome-Multimodal-Large-Language-Models if awesome-Multimodal-Large-Language-Models is a repository that compiles surveys and advancements in multimodal large language models, focusing on evaluation, unified understanding, and generation; pick GSM-IC if gSM-IC is a benchmark dataset that evaluates the distractibility of language models by introducing irrelevant context into grade-school math problems. [Awesome-Multimodal-Large-Language-Models](https://github.com/BradyFU/Awesome-Multimodal-Large-Language-Models) reports 18k GitHub stars, 1.1k forks, and 112 open issues, last pushed Sep 18, 2026. [GSM-IC](https://github.com/google-research-datasets/GSM-IC) has 67 stars, 2 forks, and 1 open issues, last pushed Feb 13, 2023. Figures are from public GitHub metadata via [Awesome-Multimodal-Large-Language-Models's repository](https://github.com/BradyFU/Awesome-Multimodal-Large-Language-Models) and [GSM-IC's repository](https://github.com/google-research-datasets/GSM-IC). | | [Awesome-Multimodal-Large-Language-Models](/tools/bradyfu-awesome-multimodal-large-language-models.md) | [GSM-IC](/tools/google-research-datasets-gsm-ic.md) | | --- | --- | --- | | Tagline | Latest Advances on Multimodal Large Language Models | GSM-IC benchmark evaluates distractibility of language models with grade-school math problems and irrelevant context. | | Stars | 18,026 | 67 | | Forks | 1,136 | 2 | | Open issues | 112 | 1 | | Language | - | - | | Adopt for | Awesome-Multimodal-Large-Language-Models is a repository that compiles surveys and advancements in multimodal large language models, focusing on evaluation, unified understanding, and generation. | GSM-IC is a benchmark dataset that evaluates the distractibility of language models by introducing irrelevant context into grade-school math problems. | | Persona | - | - | | Runtime | - | - | | License | The license information for Awesome-Multimodal-Large-Language-Models is unknown. | License information is not provided in the repository. | | Categories | Evaluation & Observability, LLM Frameworks | Evaluation & Observability | ## Trust and health _Sourced signals - not a safety guarantee. No winner column._ | | [Awesome-Multimodal-Large-Language-Models](/tools/bradyfu-awesome-multimodal-large-language-models.md) | [GSM-IC](/tools/google-research-datasets-gsm-ic.md) | | --- | --- | --- | | Maintenance | Very active (96%) | Archived (8%) | | Days since push | 0d | 1312d | | Archived on GitHub | No | Yes | | Open issues (now) | 112 | 1 | | Stars delta | +48 (30d) | 0 (30d) | | Open issues delta | +1 (30d) | 0 (30d) | | Owner type | User | Organization | | Full report | [trust report](/tools/bradyfu-awesome-multimodal-large-language-models/trust.md) | [trust report](/tools/google-research-datasets-gsm-ic/trust.md) | ## Decision facts: Awesome-Multimodal-Large-Language-Models - **Pricing:** freemium - The repository is free to use, but specific models or datasets within it may have their own licensing terms. - **Requirements:** Min 8 GB RAM; The repository does not specify hardware requirements, but working with large language models typically requires at least 8GB of RAM. - **Adopt for:** Awesome-Multimodal-Large-Language-Models is a repository that compiles surveys and advancements in multimodal large language models, focusing on evaluation, unified understanding, and generation. - **License detail:** The license information for Awesome-Multimodal-Large-Language-Models is unknown. ## Decision facts: GSM-IC - **Pricing:** unknown - Pricing details are not available. - **Requirements:** The dataset is derived from GSM8K and includes irrelevant context in problem descriptions to test the distractibility of language models. - **Adopt for:** GSM-IC is a benchmark dataset that evaluates the distractibility of language models by introducing irrelevant context into grade-school math problems. - **License detail:** License information is not provided in the repository. ## Choose when ### Choose Awesome-Multimodal-Large-Language-Models if… - Pricing: The repository is free to use, but specific models or datasets within it may have their own licensing terms.. - Requirements: Min 8 GB RAM; The repository does not specify hardware requirements, but working with large language models typically requires at least 8GB of RAM.. - Tags unique to Awesome-Multimodal-Large-Language-Models: chain-of-thought, in-context-learning, instruction-following, instruction-tuning. - Also covers LLM Frameworks. - Use Awesome-Multimodal-Large-Language-Models when you need comprehensive surveys and benchmarks for evaluating multimodal large language models. ### Choose GSM-IC if… - Pricing: Pricing details are not available.. - Requirements: The dataset is derived from GSM8K and includes irrelevant context in problem descriptions to test the distractibility of language models.. - Tags unique to GSM-IC: arithmetic reasoning, benchmark, distractibility, grade-school math. - Use GSM-IC when you need to assess how well a language model can focus on relevant information in arithmetic reasoning tasks, especially when faced with distracting irrelevant context. ## When NOT to use Awesome-Multimodal-Large-Language-Models - Avoid using Awesome-Multimodal-Large-Language-Models if you are looking for a repository that focuses solely on unimodal language models or does not cover multimodal aspects. - Do not use this repository if you require tools or surveys that are not specifically tailored to multimodal large language models, as the content here is specialized and may not cover your needs. ## When NOT to use GSM-IC - Avoid GSM-IC if your evaluation focuses on the model's ability to solve math problems without any form of distraction or if the context is always assumed to be relevant. - Do not use GSM-IC if your primary interest is in evaluating the model's performance on pure arithmetic tasks without the added complexity of irrelevant context. ## Common questions ### What is the difference between Awesome-Multimodal-Large-Language-Models and GSM-IC? Awesome-Multimodal-Large-Language-Models: Latest Advances on Multimodal Large Language Models. GSM-IC: GSM-IC benchmark evaluates distractibility of language models with grade-school math problems and irrelevant context.. See the comparison table for live GitHub stats and shared categories. ### When should I choose Awesome-Multimodal-Large-Language-Models over GSM-IC? Choose Awesome-Multimodal-Large-Language-Models over GSM-IC when Pricing: The repository is free to use, but specific models or datasets within it may have their own licensing terms.; Requirements: Min 8 GB RAM; The repository does not specify hardware requirements, but working with large language models typically requires at least 8GB of RAM.; Tags unique to Awesome-Multimodal-Large-Language-Models: chain-of-thought, in-context-learning, instruction-following, instruction-tuning; Also covers LLM Frameworks; Use Awesome-Multimodal-Large-Language-Models when you need comprehensive surveys and benchmarks for evaluating multimodal large language models. ### When should I choose GSM-IC over Awesome-Multimodal-Large-Language-Models? Choose GSM-IC over Awesome-Multimodal-Large-Language-Models when Pricing: Pricing details are not available.; Requirements: The dataset is derived from GSM8K and includes irrelevant context in problem descriptions to test the distractibility of language models.; Tags unique to GSM-IC: arithmetic reasoning, benchmark, distractibility, grade-school math; Use GSM-IC when you need to assess how well a language model can focus on relevant information in arithmetic reasoning tasks, especially when faced with distracting irrelevant context. ### When should I avoid Awesome-Multimodal-Large-Language-Models? Avoid using Awesome-Multimodal-Large-Language-Models if you are looking for a repository that focuses solely on unimodal language models or does not cover multimodal aspects. Do not use this repository if you require tools or surveys that are not specifically tailored to multimodal large language models, as the content here is specialized and may not cover your needs. ### When should I avoid GSM-IC? Avoid GSM-IC if your evaluation focuses on the model's ability to solve math problems without any form of distraction or if the context is always assumed to be relevant. Do not use GSM-IC if your primary interest is in evaluating the model's performance on pure arithmetic tasks without the added complexity of irrelevant context. ### Is Awesome-Multimodal-Large-Language-Models or GSM-IC more popular on GitHub? Awesome-Multimodal-Large-Language-Models has more GitHub stars (18,026 vs 67). Stars measure visibility, not whether either tool fits your constraints. ### Are Awesome-Multimodal-Large-Language-Models and GSM-IC open source? Yes - both are open-source projects on GitHub. ### Where can I find alternatives to Awesome-Multimodal-Large-Language-Models or GSM-IC? GraphCanon lists graph-backed alternatives at [Awesome-Multimodal-Large-Language-Models alternatives](/tools/bradyfu-awesome-multimodal-large-language-models/alternatives) and [GSM-IC alternatives](/tools/google-research-datasets-gsm-ic/alternatives) ([Awesome-Multimodal-Large-Language-Models markdown twin](/tools/bradyfu-awesome-multimodal-large-language-models/alternatives.md), [GSM-IC markdown twin](/tools/google-research-datasets-gsm-ic/alternatives.md)), ranked by typed relationship edges rather than popularity votes. ### Is there a machine-readable version of this comparison? Yes. The markdown twin at [this comparison](/compare/bradyfu-awesome-multimodal-large-language-models-vs-google-research-datasets-gsm-ic.md) mirrors this page for agents and LLM crawlers, with the same stats table and FAQ answers. ### Which is better maintained, Awesome-Multimodal-Large-Language-Models or GSM-IC? Awesome-Multimodal-Large-Language-Models: Very active. GSM-IC: Archived. Compare maintenance labels, days since push, and release cadence in the trust section below - stars alone do not measure maintenance. ### Where are the full trust reports for Awesome-Multimodal-Large-Language-Models and GSM-IC? GraphCanon publishes per-repo trust reports with dated maintenance, provenance, and scan summaries: [Awesome-Multimodal-Large-Language-Models trust report](/tools/bradyfu-awesome-multimodal-large-language-models/trust); [GSM-IC trust report](/tools/google-research-datasets-gsm-ic/trust). --- **Machine-readable endpoints** - JSON: [`/api/graphcanon/graph?tool=bradyfu-awesome-multimodal-large-language-models`](/api/graphcanon/graph?tool=bradyfu-awesome-multimodal-large-language-models) - LLM index: [/llms.txt](/llms.txt) - Full corpus: [/llms-full.txt](/llms-full.txt) _GraphCanon - The knowledge graph for AI development. https://www.graphcanon.com/_