GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026
54views this month
Decision brief
Scalable toolkit for data pre-processing tailored to LLMs, featuring deduplication and quality checks.
Good fit when
- You're working with NVIDIA NeMo models and require seamless integration.
- Your project demands semantic-based deduplication techniques.
Avoid when
- Your dataset doesn't align with NVIDIA hardware specifications.
- You prefer data curation tools that do not emphasize semantic processing.
Observed Jul 12, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Very active (0d since push)
- As of Sep 19, 2026
- Provenance
- Not a fork · Organization account
- As of Sep 19, 2026
- Security (OSV)
- No lockfile
- As of Jul 11, 2026
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
pip install CuratorSimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
NVIDIA-NeMo/Curator is a Python-based repository offering tools for scalable data processing and curation specifically designed for Large Language Models (LLMs). It includes functionalities such as deduplication, quality checks, and preparation pipelines which are crucial steps before the training phase of AI models.
Capability facts
- Languages
- python
Source: github.language+pyproject.toml · Sep 19, 2026
Categories
Compatibility
Sourced claims from the README excerpt - not unsourced marketing copy.
Source: README excerpt (regex_v1, Sep 19, 2026)
Supported Python and dependency versions are defined in [`pyproject.toml`](pyproject.toml); the PSource link
Tags
README
Quick Start Three paths, depending on what you're trying to do. Each path is self contained. NeMo Curator uses for installation. Install it once: Path C — Docker (recommended for video and audio) Video and audio pipelines depend on system codec libraries; the published container...
For agents
This page has a .md twin and JSON over the API.