Comparison
Awesome-Multimodal-Large-Language-Models vs DevEval
Verdict
Pick Awesome-Multimodal-Large-Language-Models when tags unique to Awesome-Multimodal-Large-Language-Models: chain-of-thought, instruction-tuning, multi-modality, large-language-models; pick DevEval when tags unique to DevEval: python.
Markdown twin · Awesome-Multimodal-Large-Language-Models alternatives · DevEval alternatives
GraphCanon updated today
Awesome-Multimodal-Large-Language-Models
BradyFU/Awesome-Multimodal-Large-Language-Models
Trust & integrity
| Signal | Awesome-Multimodal-Large-Language-Models | DevEval |
|---|---|---|
| Maintenance | Active (8d since push) As of today · github_public_v1 | Dormant (772d since push) As of today · github_public_v1 |
| Provenance | Not a fork · Personal account As of today · github_public_v1 | Not a fork · Organization account As of today · github_public_v1 |
| Security (OSV) | No lockfile As of today · none | No lockfile As of today · none |
Tagline
- Awesome-Multimodal-Large-Language-Models
- Latest Advances on Multimodal Large Language Models
- DevEval
- A Comprehensive Benchmark for Software Development.
Stars
- Awesome-Multimodal-Large-Language-Models
- 18k
- DevEval
- 134
Forks
- Awesome-Multimodal-Large-Language-Models
- 1.1k
- DevEval
- 13
Open issues
- Awesome-Multimodal-Large-Language-Models
- 104
- DevEval
- 0
Language
- Awesome-Multimodal-Large-Language-Models
- -
- DevEval
- Python
Adopt for
- Awesome-Multimodal-Large-Language-Models
- Awesome-Multimodal-Large-Language-Models is a curated collection of surveys and benchmarks focused on multimodal large language models (MLLMs), encompassing evaluation frameworks, interactive Omni MLLMs, and benchmarking
- DevEval
- -
Persona
- Awesome-Multimodal-Large-Language-Models
- -
- DevEval
- -
Runtime
- Awesome-Multimodal-Large-Language-Models
- -
- DevEval
- -
License
- Awesome-Multimodal-Large-Language-Models
- -
- DevEval
- Apache-2.0
Last pushed
- Awesome-Multimodal-Large-Language-Models
- Jul 2, 2026
- DevEval
- May 30, 2024
Categories
- Awesome-Multimodal-Large-Language-Models
- LLM Frameworks, Evaluation & Observability
- DevEval
- Evaluation & Observability
Trust and health
Maintenance
- Awesome-Multimodal-Large-Language-Models
- Active (82%)
- DevEval
- Dormant (18%)
Days since push
- Awesome-Multimodal-Large-Language-Models
- 8d
- DevEval
- 772d
Open issues (now)
- Awesome-Multimodal-Large-Language-Models
- 104
- DevEval
- 0
Owner type
- Awesome-Multimodal-Large-Language-Models
- User
- DevEval
- Organization
Full report
- Awesome-Multimodal-Large-Language-Models
- Trust report
- DevEval
- Trust report
Choose Awesome-Multimodal-Large-Language-Models if…
- Tags unique to Awesome-Multimodal-Large-Language-Models: chain-of-thought, instruction-tuning, multi-modality, large-language-models.
- Also covers LLM Frameworks.
- - You need comprehensive resources for evaluating multimodal LLMs and want access to the latest research findings in this area.
When NOT to use Awesome-Multimodal-Large-Language-Models
- - If your primary focus is on single-modality language models, without a need to integrate visual or audio elements.
- - If you prefer tools that provide hands-on implementation guidance rather than surveys and benchmarks for theoretical exploration.
Choose DevEval if…
- Tags unique to DevEval: python.
- Leaner open-issue backlog (0).
When NOT to use DevEval
- Last GitHub push was 772 days ago (dormant maintenance, May 30, 2024). Validate activity before betting a new project on DevEval.
- Evaluation & Observability: Defer heavyweight eval infra only until you have real traffic - never skip it once users depend on answers.
Explore
Sources
Every stat on this page traces to a dated GitHub sync, license file, enrichment field, or trust scan.
- GitHub stars (BradyFU/Awesome-Multimodal-Large-Language-Models) · observed Jul 11, 2026
- GitHub forks (BradyFU/Awesome-Multimodal-Large-Language-Models) · observed Jul 11, 2026
- Last push (BradyFU/Awesome-Multimodal-Large-Language-Models) · observed Jul 2, 2026
- License file (unknown) · observed Jul 11, 2026
- Decision facts (enrichment) · observed Jul 11, 2026
- Trust scan (lockfile / OSV) · observed Jul 11, 2026
- GitHub stars (open-compass/DevEval) · observed Jul 11, 2026
- GitHub forks (open-compass/DevEval) · observed Jul 11, 2026
- Last push (open-compass/DevEval) · observed May 30, 2024
- License file (Apache-2.0) · observed Jul 11, 2026
- Trust scan (lockfile / OSV) · observed Jul 11, 2026
GitHub stars on cards: Awesome-Multimodal-Large-Language-Models 18k · DevEval 134 (synced Jul 11, 2026).
Common questions
- What is the difference between Awesome-Multimodal-Large-Language-Models and DevEval?
- Awesome-Multimodal-Large-Language-Models: Latest Advances on Multimodal Large Language Models. DevEval: A Comprehensive Benchmark for Software Development.. See the comparison table for live GitHub stats and shared categories.
- When should I choose Awesome-Multimodal-Large-Language-Models over DevEval?
- Choose Awesome-Multimodal-Large-Language-Models over DevEval when Tags unique to Awesome-Multimodal-Large-Language-Models: chain-of-thought, instruction-tuning, multi-modality, large-language-models; Also covers LLM Frameworks; - You need comprehensive resources for evaluating multimodal LLMs and want access to the latest research findings in this area.
- When should I choose DevEval over Awesome-Multimodal-Large-Language-Models?
- Choose DevEval over Awesome-Multimodal-Large-Language-Models when Tags unique to DevEval: python; Leaner open-issue backlog (0).
- When should I avoid Awesome-Multimodal-Large-Language-Models?
- - If your primary focus is on single-modality language models, without a need to integrate visual or audio elements. - If you prefer tools that provide hands-on implementation guidance rather than surveys and benchmarks for theoretical exploration.
- When should I avoid DevEval?
- Last GitHub push was 772 days ago (dormant maintenance, May 30, 2024). Validate activity before betting a new project on DevEval. Evaluation & Observability: Defer heavyweight eval infra only until you have real traffic - never skip it once users depend on answers.
- Is Awesome-Multimodal-Large-Language-Models or DevEval more popular on GitHub?
- Awesome-Multimodal-Large-Language-Models has more GitHub stars (17,937 vs 134). Stars measure visibility, not whether either tool fits your constraints.
- Are Awesome-Multimodal-Large-Language-Models and DevEval open source?
- Yes - both are open-source projects on GitHub.
- Where can I find alternatives to Awesome-Multimodal-Large-Language-Models or DevEval?
- GraphCanon lists graph-backed alternatives at Awesome-Multimodal-Large-Language-Models alternatives and DevEval alternatives (Awesome-Multimodal-Large-Language-Models markdown twin, DevEval markdown twin), ranked by typed relationship edges rather than popularity votes.
- Is there a machine-readable version of this comparison?
- Yes. The markdown twin at this comparison mirrors this page for agents and LLM crawlers, with the same stats table and FAQ answers.
- Which is better maintained, Awesome-Multimodal-Large-Language-Models or DevEval?
- Awesome-Multimodal-Large-Language-Models: Active. DevEval: Dormant. Compare maintenance labels, days since push, and release cadence in the trust section below - stars alone do not measure maintenance.
- Where are the full trust reports for Awesome-Multimodal-Large-Language-Models and DevEval?
- GraphCanon publishes per-repo trust reports with dated maintenance, provenance, and scan summaries: Awesome-Multimodal-Large-Language-Models trust report; DevEval trust report.