transformers vs Megatron-LM
A neutral, constraint-first comparison - live GitHub stats and typed relationships, not marketing.
| transformers | Megatron-LM | |
|---|---|---|
| Tagline | 🤗 Transformers: the model-definition framework for state-of-the-art machine learning models | GPU-optimized library for training transformer models at scale |
| Stars | 162k | 17k |
| Forks | 34k | 4.2k |
| Open issues | 2.5k | 990 |
| Language | Python | Python |
| License | Apache-2.0 | Other |
| Last pushed | Jul 7, 2026 | Jul 7, 2026 |
| Categories | Model Training, Data & Retrieval, LLM Frameworks | LLM Frameworks |
transformers
Repo hosts a Python library and framework for NLP, text, audio, vision, multimodal AI model creation, training and inference using PyTorch.
Python
Megatron-LM
Megatron-LM is a repository containing Megatron Core, which provides GPU-optimized building blocks for custom training frameworks, and includes pre-configured training scripts for quick experimentation.
Python