LLMs-from-scratch vs HRM

A neutral, constraint-first comparison - live GitHub stats and typed relationships, not marketing.

LLMs-from-scratchHRM
TaglineImplement a ChatGPT-like LLM in PyTorch from scratchHierarchical Reasoning Model Official Release
Stars99k13k
Forks15k1.8k
Open issues476
LanguageJupyter NotebookPython
LicenseOtherApache-2.0
Last pushedJun 2, 2026Mar 31, 2026
CategoriesModel Training, LLM FrameworksEvaluation & Observability, LLM Frameworks

LLMs-from-scratch

Repository containing code and instructions for developing, pretraining, and finetuning a GPT-like large language model (LLM) using PyTorch.

Jupyter Notebook

HRM

HRM is a brain-inspired hierarchical recurrent architecture that excels in complex reasoning tasks with minimal data and parameters, outperforming larger models on benchmarks like ARC.

Python