lmms-eval alternatives
Open-source alternatives to lmms-eval in AI Agents, Inference & Serving, LLM Frameworks, connected by typed relationships and shared categories - ranked with live GitHub stats, not marketing.
Head-to-head comparisons
Also in the same categories
Tools that solve adjacent problems in lmms-eval's categories.
AutoGPT
Significant-Gravitas/AutoGPT
AutoGPT: Build, Deploy, and Run AI Agents
ollama
ollama/ollama
Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
prompts.chat
f/prompts.chat
The world's largest open-source prompt library for AI
dify
langgenius/dify
Production-ready platform for agentic workflow development
open-webui
open-webui/open-webui
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
awesome-llm-apps
Shubhamsaboo/awesome-llm-apps
100+ AI Agent & RAG apps you can actually run — clone, customize, ship.
gemini-cli
google-gemini/gemini-cli
Gemini CLI - An AI agent for your terminal
LLMs-from-scratch
rasbt/LLMs-from-scratch
Implement a ChatGPT-like LLM in PyTorch from scratch
TradingAgents
TauricResearch/TradingAgents
TradingAgents: Multi-Agents LLM Financial Trading Framework
claude-mem
thedotmack/claude-mem
Persistent Context Across Sessions for Every Agent
caveman
JuliusBrussee/caveman
Cuts 65% of tokens in AI coding agent responses.
vllm
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
ragflow
infiniflow/ragflow
RAGFlow: A powerful Retrieval-Augmented Generation with enhanced Agent capabilities in Go
