VLMEvalKit vs LLMs-from-scratch
A neutral, constraint-first comparison - live GitHub stats and typed relationships, not marketing.
| VLMEvalKit | LLMs-from-scratch | |
|---|---|---|
| Tagline | A Toolkit for Evaluating Large Vision-Language Models | Implement a ChatGPT-like LLM in PyTorch from scratch |
| Stars | 4.3k | 99k |
| Forks | 729 | 15k |
| Open issues | 264 | 4 |
| Language | Python | Jupyter Notebook |
| License | Apache-2.0 | Other |
| Last pushed | Jul 5, 2026 | Jun 2, 2026 |
| Categories | Evaluation & Observability | Model Training, LLM Frameworks |
VLMEvalKit
Open-source evaluation toolkit supporting over 220 large multi-modality models (LMMs) and more than 80 benchmarks.
Python
LLMs-from-scratch
Repository containing code and instructions for developing, pretraining, and finetuning a GPT-like large language model (LLM) using PyTorch.
Jupyter Notebook