lmms-eval vs ollama
A neutral, constraint-first comparison - live GitHub stats and typed relationships, not marketing.
| lmms-eval | ollama | |
|---|---|---|
| Tagline | One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks | Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. |
| Stars | 4.3k | 176k |
| Forks | 613 | 17k |
| Open issues | 43 | 3.4k |
| Language | Python | Go |
| License | Other | MIT |
| Last pushed | Jul 7, 2026 | Jul 7, 2026 |
| Categories | Evaluation & Observability | AI Agents, LLM Frameworks |
lmms-eval
A unified evaluation toolkit for large multimodal models focusing on reproducibility, efficiency, and trustworthiness.
Python
ollama
Ollama is a platform for deploying and interacting with various large language models (LLMs) such as Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, and Gemma on macOS, Windows, Linux, and Docker environments.
Go