transformers vs LLMs-from-scratch

A neutral, constraint-first comparison - live GitHub stats and typed relationships, not marketing.

transformersLLMs-from-scratch
Tagline🤗 Transformers: the model-definition framework for state-of-the-art machine learning modelsImplement a ChatGPT-like LLM in PyTorch from scratch
Stars162k99k
Forks34k15k
Open issues2.5k4
LanguagePythonJupyter Notebook
LicenseApache-2.0Other
Last pushedJul 7, 2026Jun 2, 2026
CategoriesData & Retrieval, Model Training, LLM FrameworksModel Training, LLM Frameworks

transformers

Repo hosts a Python library and framework for NLP, text, audio, vision, multimodal AI model creation, training and inference using PyTorch.

Python

LLMs-from-scratch

Repository containing code and instructions for developing, pretraining, and finetuning a GPT-like large language model (LLM) using PyTorch.

Jupyter Notebook