LLMs-from-scratch vs sglang

A neutral, constraint-first comparison - live GitHub stats and typed relationships, not marketing.

LLMs-from-scratchsglang
TaglineImplement a ChatGPT-like LLM in PyTorch from scratchSGLang high-performance serving framework
Stars99k30k
Forks15k7.0k
Open issues44.0k
LanguageJupyter NotebookPython
LicenseOtherApache-2.0
Last pushedJun 2, 2026Jul 7, 2026
CategoriesModel Training, LLM FrameworksInference & Serving

LLMs-from-scratch

Repository containing code and instructions for developing, pretraining, and finetuning a GPT-like large language model (LLM) using PyTorch.

Jupyter Notebook

sglang

A Python-based serving framework designed for large language models and multimodal models, supporting speculative decoding, deep learning applications, and integration with various hardware accelerators.

Python