nanotron logo

nanotron

huggingface/nanotron

Minimalistic large language model 3D-parallelism training

GraphCanon updated 2w · GitHub synced 2w · 30 views this month

2.8k stars329 forksLast push 2mo Python Apache-2.0

Decision brief

Nanotron specializes in minimalistic large language model 3D-parallelism training via efficient distributed computing techniques.

Good fit when

  • You aim to implement 3D-parallelism for large language models with minimal code complexity and high efficiency.
  • Your project is centered around Python and you are looking to optimize distributed training processes without the extra bloat.

Avoid when

  • You require robust integration capabilities that come with larger, more feature-rich training frameworks.
  • Need extensive out-of-the-box solutions for common data processing tasks as Nanotron focuses narrowly on parallelism and efficient computing, potentially missing broader functionalities.

Observed Jul 14, 2026 · Source: enrich:decision_facts

Verify the decision

Maintenance and security

Full trust report
Maintenance
Steady (72d since push)
As of 2w
Provenance
Not a fork · Organization account
As of 2w
Security (OSV)
No lockfile
As of 1mo

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Backing

Company context for Hugging Face. Display-only - separate from trust and ranking.

Company
Hugging Face·GitHub org profile·1mo
Employees
160·Wikidata (P1128 employees)·1mo
Funding
$235,000,000 (2023-08)·GraphCanon curated seed (public press)·1mo
Commercial model
OSS + managed cloud·GraphCanon curated seed·1mo

Install

pip install nanotron
PyPI

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

A minimalistic repository for 3D-parallelism in large language model training, focused on efficient distributed computing.

Capability facts

Languages
python

Source: github.language+pyproject.toml · Aug 7, 2026

Categories

Graph entities

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Python runtimePython

Source: README excerpt (regex_v1, Aug 7, 2026)

To run the code in this project, first create a Python virtual environment using e.g. `uv`:
Source link

Tags

README

Installation

To run the code in this project, first create a Python virtual environment using e.g. uv:

uv venv nanotron --python 3.11 && source nanotron/bin/activate && uv pip install --upgrade pip

[!TIP] For Hugging Face cluster users, add export UV_LINK_MODE=copy to your .bashrc to suppress cache warnings from uv

Next, install Pytorch:

uv pip install torch --index-url https://download.pytorch.org/whl/cu124

Then install the core dependencies with:

uv pip install -e .

To run the example scripts, install the remaining dependencies as follows:

uv pip install datasets transformers datatrove[io] numba wandb

For agents

This page has a .md twin and JSON over the API.

Was this helpful?

Anonymous feedback helps us improve pages and translations.