LLMs-from-scratch vs FlashRAG

A neutral, constraint-first comparison - live GitHub stats and typed relationships, not marketing.

LLMs-from-scratchFlashRAG
TaglineImplement a ChatGPT-like LLM in PyTorch from scratchFlashRAG: A Python Toolkit for Efficient RAG Research
Stars99k3.5k
Forks15k306
Open issues437
LanguageJupyter NotebookPython
LicenseOtherMIT
Last pushedJun 2, 2026Apr 10, 2026
CategoriesModel Training, LLM FrameworksLLM Frameworks

LLMs-from-scratch

Repository containing code and instructions for developing, pretraining, and finetuning a GPT-like large language model (LLM) using PyTorch.

Jupyter Notebook

FlashRAG

FlashRAG is a Python toolkit designed for efficient research in Retrieval Augmented Generation (RAG), offering pre-processed datasets, state-of-the-art algorithms, and an easy-to-use UI.

Python