prometheus-eval vs awesome-llm-apps

A neutral, constraint-first comparison - live GitHub stats and typed relationships, not marketing.

prometheus-evalawesome-llm-apps
TaglineEvaluate your LLM's response with Prometheus and GPT4100+ AI Agent & RAG apps you can actually run — clone, customize, ship.
Stars1.1k117k
Forks7117k
Open issues146
LanguagePythonPython
LicenseApache-2.0Apache-2.0
Last pushedApr 25, 2025Jun 15, 2026
CategoriesEvaluation & Observability, LLM FrameworksAI Agents, LLM Frameworks

prometheus-eval

Prometheus-Eval is a Python-based tool for evaluating the performance of large language models using metrics from Prometheus and interactions with GPT-4.

Python

awesome-llm-apps

A repository containing a collection of AI agent and Retrieval-Augmented Generation (RAG) applications that are ready to be cloned, customized, and deployed. The projects cover various aspects such as AI agents, always-on agents, multi-agent teams, RAG techniques, voice agents, fine-tuning for specific use cases, and more.

Python