gpt-neox
Implementation of model parallel autoregressive transformers on GPUs based on Megatron and DeepSpeed libraries
GraphCanon updated 1w · GitHub synced 1w
Decision brief
GPT-NeoX from EleutherAI leverages GPU-based model parallelism via Megatron and DeepSpeed libraries to facilitate the training of large-scale autoregressive transformers in Python, under an Apache-2.0 license.
Good fit when
- - When your project requires a framework based on state-of-the-art libraries like Megatron and DeepSpeed that are optimized for large GPU clusters.
- - If you aim to train extremely large language models, leveraging distributed model parallelism across multiple GPUs which can scale beyond the capacity of single-GPU limits.
Avoid when
- - In scenarios where minimal hardware resources, such as a single low-memory GPU or CPU-only environments, are available for training due to GPT-NeoX's requirement for a large-scale infrastructure.
- - If your project is limited by the Apache License terms or requires proprietary codebases without open-source contributions and modifications from external parties.
- Pricing:
- freemium - Free to use with the caveat of adhering to the Apache License terms, particularly in preserving copyright and license headers for all derivations.
Observed Jul 12, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Steady (56d since push)
- As of 1w
- Provenance
- Not a fork · Organization account
- As of 1w
- Security (OSV)
- No lockfile
- As of 1mo
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
pip install gpt-neoxSimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
EleutherAI's GPT-NeoX project focusing on creating large-scale language models using GPU-based model parallelism with the support of Megatron and DeepSpeed.
Capability facts
- Languages
- python
Source: github.language · Aug 7, 2026
Categories
Tags
README
Licensing
This repository hosts code that is part of EleutherAI's GPT-NeoX project. Copyright (c) 2024, EleutherAI. Licensed under the Apache License:
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
This repository is based off code written by NVIDIA that is licensed under the Apache License, Version 2.0. In accordance with the Apache License, all files that are modifications of code originally written by NVIDIA maintain a NVIDIA copyright header. All files that do not contain such a header are the exclusive copyright of EleutherAI. When the NVIDIA code has been modified from its original version, that fact is noted in the copyright header. All derivative works of this repository must preserve these headers under the terms of the Apache License.
This repository also contains code written by a number of other authors. Such contributions are marked and the relevant licensing is included where appropriate.
For full terms, see the LICENSE file. If you have any questions, comments, or concerns about licensing please email us at contact@eleuther.ai.
For agents
This page has a .md twin and JSON over the API.