---
title: "Megatron-LM vs LLMs-from-scratch"
type: "comparison"
canonical_url: "https://www.graphcanon.com/compare/nvidia-megatron-lm-vs-rasbt-llms-from-scratch"
tools: ["nvidia-megatron-lm", "rasbt-llms-from-scratch"]
---

# Megatron-LM vs LLMs-from-scratch

Neutral, constraint-first comparison with live GitHub stats.

| | [Megatron-LM](/tools/nvidia-megatron-lm.md) | [LLMs-from-scratch](/tools/rasbt-llms-from-scratch.md) |
| --- | --- | --- |
| Tagline | GPU-optimized library for training transformer models at scale | Implement a ChatGPT-like LLM in PyTorch from scratch |
| Stars | 16,988 | 98,715 |
| Forks | 4,198 | 15,148 |
| Open issues | 990 | 4 |
| Language | Python | Jupyter Notebook |
| License | Other | Other |
| Categories | LLM Frameworks | Model Training, LLM Frameworks |

---

**Machine-readable endpoints**

- JSON: [`/api/graphcanon/graph?tool=nvidia-megatron-lm`](/api/graphcanon/graph?tool=nvidia-megatron-lm)
- LLM index: [/llms.txt](/llms.txt)
- Full corpus: [/llms-full.txt](/llms-full.txt)

_GraphCanon - The knowledge graph for AI development. https://www.graphcanon.com/_