prometheus-eval vs LLMs-from-scratch
A neutral, constraint-first comparison - live GitHub stats and typed relationships, not marketing.
| prometheus-eval | LLMs-from-scratch | |
|---|---|---|
| Tagline | Evaluate your LLM's response with Prometheus and GPT4 | Implement a ChatGPT-like LLM in PyTorch from scratch |
| Stars | 1.1k | 99k |
| Forks | 71 | 15k |
| Open issues | 14 | 4 |
| Language | Python | Jupyter Notebook |
| License | Apache-2.0 | Other |
| Last pushed | Apr 25, 2025 | Jun 2, 2026 |
| Categories | Evaluation & Observability | Model Training, LLM Frameworks |
prometheus-eval
Prometheus-Eval is a Python-based repository for evaluating Large Language Models (LLMs) in generation tasks. It includes tools and benchmarks designed to assess the performance of LLMs across various evaluation metrics, particularly focusing on multilingual contexts.
Python
LLMs-from-scratch
Repository containing code and instructions for developing, pretraining, and finetuning a GPT-like large language model (LLM) using PyTorch.
Jupyter Notebook