MGM vs LLMs-from-scratch

A neutral, constraint-first comparison - live GitHub stats and typed relationships, not marketing.

MGMLLMs-from-scratch
TaglineOfficial repo for 'Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models'Implement a ChatGPT-like LLM in PyTorch from scratch
Stars3.3k99k
Forks27515k
Open issues614
LanguagePythonJupyter Notebook
LicenseApache-2.0Other
Last pushedMay 4, 2024Jun 2, 2026
CategoriesLLM Frameworks, Model TrainingModel Training, LLM Frameworks

MGM

A Python-based framework supporting dense and MoE Large Language Models (LLMs) from 2B to 34B, focusing on image understanding, reasoning, and generation. Built based on LLaVA.

Python

LLMs-from-scratch

Repository containing code and instructions for developing, pretraining, and finetuning a GPT-like large language model (LLM) using PyTorch.

Jupyter Notebook