Home/LLM Frameworks/gpt-neox

gpt-neox

EleutherAI/gpt-neox

Model parallel autoregressive transformers on GPUs

GitHub Website

GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026

60views this month

7.5k stars1.1k forksLast push Sep 4, 2026 Python Apache-2.0

Decision brief

GPT-NeoX is a model parallel autoregressive transformer implementation on GPUs, leveraging Megatron and DeepSpeed libraries.

Good fit when

When you need to train large language models on GPUs and require model parallelism to handle the computational demands.
If your project benefits from the integration of Megatron and DeepSpeed libraries, which offer advanced features for training large models efficiently.

Avoid when

If your project does not require the scale of model parallelism and can be handled with single-GPU setups, GPT-NeoX might introduce unnecessary complexity.
When the specific features of Megatron and DeepSpeed are not aligned with your project's needs, opting for a simpler framework might be more suitable.

Requirements:: Min 16 GB RAM; Requires GPU support for optimal performance.; Integration with Megatron and DeepSpeed libraries is essential for full functionality.

Observed Sep 18, 2026 · Source: enrich:decision_facts

gpt-neox alternatives Trust report

Verify the decision

Maintenance and security

Full trust report

Maintenance: Active (13d since push); As of Sep 18, 2026
Provenance: Not a fork · Organization account; As of Sep 18, 2026
Security (OSV): No lockfile; As of Sep 18, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

pip install gpt-neox

PyPI

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

transformers

🤗 Transformers: state-of-the-art machine learning models for text, vision, audio, and multimodal models

166k★

pytorch-lightning

Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.

31k★

Megatron-LM

Ongoing research training transformer models at scale

18k★

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

EleutherAI's GPT-NeoX project implements model parallel autoregressive transformers on GPUs using the Megatron and DeepSpeed libraries.

Capability facts

Languages: python
Source: github.language · Sep 18, 2026

README

Licensing This repository hosts code that is part of EleutherAI's GPT NeoX project. Copyright (c) 2024, EleutherAI. Licensed under the Apache License: Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License....

For agents

This page has a .md twin and JSON over the API.

/tools/eleutherai-gpt-neox.md GET /api/graphcanon/tools/eleutherai-gpt-neox GET /api/graphcanon/graph?tool=eleutherai-gpt-neox