{"data":{"slug":"eleutherai-gpt-neox","name":"gpt-neox","tagline":"Model parallel autoregressive transformers on GPUs","github_url":"https://github.com/EleutherAI/gpt-neox","owner":"EleutherAI","repo":"gpt-neox","owner_avatar_url":"https://avatars.githubusercontent.com/u/68924597?v=4","primary_language":"Python","stars":7461,"forks":1121,"topics":["deepspeed-library","gpt-3","language-model","transformers"],"archived":false,"github_pushed_at":"2026-09-04T21:41:34+00:00","maintenance_label":"Active","stars_delta_30d":9,"url":"https://www.graphcanon.com/tools/eleutherai-gpt-neox","markdown_url":"https://www.graphcanon.com/tools/eleutherai-gpt-neox.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/eleutherai-gpt-neox","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=eleutherai-gpt-neox","description":"An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries","homepage_url":"https://www.eleuther.ai/","license":"Apache-2.0","open_issues":118,"watchers":126,"ai_summary":"EleutherAI's GPT-NeoX project implements model parallel autoregressive transformers on GPUs using the Megatron and DeepSpeed libraries.","readme_excerpt":"## Licensing\n\nThis repository hosts code that is part of EleutherAI's GPT-NeoX project. Copyright (c) 2024, EleutherAI. Licensed under the Apache License:\n\n    Licensed under the Apache License, Version 2.0 (the \"License\");\n    you may not use this file except in compliance with the License.\n    You may obtain a copy of the License at\n\n        http://www.apache.org/licenses/LICENSE-2.0\n\n    Unless required by applicable law or agreed to in writing, software\n    distributed under the License is distributed on an \"AS IS\" BASIS,\n    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\n    See the License for the specific language governing permissions and\n    limitations under the License.\n\nThis repository is based off code written by NVIDIA that is licensed under the Apache License, Version 2.0. In accordance with the Apache License, all files that are modifications of code originally written by NVIDIA maintain a NVIDIA copyright header. All files that do not contain such a header are the exclusive copyright of EleutherAI. When the NVIDIA code has been modified from its original version, that fact is noted in the copyright header. All derivative works of this repository must preserve these headers under the terms of the Apache License.\n\nThis repository also contains code written by a number of other authors. Such contributions are marked and the relevant licensing is included where appropriate.\n\nFor full terms, see the `LICENSE` file. If you have any questions, comments, or concerns about licensing please email us at contact@eleuther.ai.","github_created_at":"2020-12-22T14:37:54+00:00","created_at":"2026-07-11T10:36:25.893267+00:00","updated_at":"2026-09-20T04:29:21.130544+00:00","categories":[{"slug":"llm-frameworks","name":"LLM Frameworks","url":"https://www.graphcanon.com/categories/llm-frameworks","markdown_url":"https://www.graphcanon.com/categories/llm-frameworks.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/llm-frameworks"},{"slug":"model-training","name":"Model Training","url":"https://www.graphcanon.com/categories/model-training","markdown_url":"https://www.graphcanon.com/categories/model-training.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/model-training"}],"tags":[{"slug":"autoregressive-transformers","name":"autoregressive-transformers"},{"slug":"deepspeed-library","name":"deepspeed-library"},{"slug":"gpt-3","name":"gpt-3"},{"slug":"gpu","name":"gpu"},{"slug":"language-model","name":"language-model"},{"slug":"megatron","name":"megatron"},{"slug":"model-parallel","name":"model-parallel"},{"slug":"transformers","name":"transformers"}],"trust":{"provenance":{"is_fork":false,"github_id":323651234,"owner_type":"Organization","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-09-18T08:15:02.272Z","maintenance":{"label":"Active","score":82,"methodology":"github_public_v1","releases_90d":0,"days_since_push":13,"last_release_at":"2023-03-10T00:26:35Z","stars_delta_30d":9,"open_issues_delta_30d":7},"security_summary":{"status":"no_lockfile","scanner":null,"low_count":0,"high_count":0,"last_scan_at":"2026-09-18T08:15:03.930Z","medium_count":0,"scan_profile":"none","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-09-18T08:15:01.185Z"},"languages":{"value":["python"],"source":"github.language","observed_at":"2026-09-18T08:15:01.185Z"},"license_spdx":{"value":"Apache-2.0","source":"github.license","observed_at":"2026-09-18T08:15:01.185Z"}},"decision_facts":{"hosting":null,"pricing":null,"requirements":{"notes":["Requires GPU support for optimal performance.","Integration with Megatron and DeepSpeed libraries is essential for full functionality."],"min_ram_gb":16,"requires_docker":false},"constraints":{"min_ram_gb":16,"requires_docker":false},"when_to_use":["When you need to train large language models on GPUs and require model parallelism to handle the computational demands.","If your project benefits from the integration of Megatron and DeepSpeed libraries, which offer advanced features for training large models efficiently."],"when_not_to_use":["If your project does not require the scale of model parallelism and can be handled with single-GPU setups, GPT-NeoX might introduce unnecessary complexity.","When the specific features of Megatron and DeepSpeed are not aligned with your project's needs, opting for a simpler framework might be more suitable."],"source":"enrich:decision_facts","observed_at":"2026-09-18T09:31:43.620Z"},"constraint_facets":{"min_ram_gb":16,"requires_docker":false},"decision_summary":[{"label":"Requirements","value":"Min 16 GB RAM; Requires GPU support for optimal performance.; Integration with Megatron and DeepSpeed libraries is essential for full functionality."},{"label":"Adopt for","value":"GPT-NeoX is a model parallel autoregressive transformer implementation on GPUs, leveraging Megatron and DeepSpeed libraries."},{"label":"License detail","value":"GPT-NeoX is licensed under the Apache License, Version 2.0, which allows for free use, modification, and distribution of the software, provided that the license terms are adhered to."}]}}