transformers vs prometheus-eval
A neutral, constraint-first comparison - live GitHub stats and typed relationships, not marketing.
| transformers | prometheus-eval | |
|---|---|---|
| Tagline | 🤗 Transformers: the model-definition framework for state-of-the-art machine learning models | Evaluate your LLM's response with Prometheus and GPT4 |
| Stars | 162k | 1.1k |
| Forks | 34k | 71 |
| Open issues | 2.5k | 14 |
| Language | Python | Python |
| License | Apache-2.0 | Apache-2.0 |
| Last pushed | Jul 7, 2026 | Apr 25, 2025 |
| Categories | Model Training, Data & Retrieval, LLM Frameworks | Evaluation & Observability |
transformers
Repo hosts a Python library and framework for NLP, text, audio, vision, multimodal AI model creation, training and inference using PyTorch.
Python
prometheus-eval
Prometheus-Eval is a Python-based repository for evaluating Large Language Models (LLMs) in generation tasks. It includes tools and benchmarks designed to assess the performance of LLMs across various evaluation metrics, particularly focusing on multilingual contexts.
Python