lmms-eval vs AutoGPT
A neutral, constraint-first comparison - live GitHub stats and typed relationships, not marketing.
| lmms-eval | AutoGPT | |
|---|---|---|
| Tagline | One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks | AutoGPT: Build, Deploy, and Run AI Agents |
| Stars | 4.3k | 185k |
| Forks | 613 | 46k |
| Open issues | 43 | 468 |
| Language | Python | Python |
| License | Other | Other |
| Last pushed | Jul 7, 2026 | Jul 7, 2026 |
| Categories | Evaluation & Observability | AI Agents, Developer Tools |
lmms-eval
A unified evaluation toolkit for large multimodal models focusing on reproducibility, efficiency, and trustworthiness.
Python