GraphCanon
Home/Compare/horovod vs Megatron-LM

Comparison

horovod vs Megatron-LM

Verdict

Pick horovod if simplify distributed deep learning training for TensorFlow, Keras, PyTorch, and MXNet with minimal code changes; pick Megatron-LM if megatron-LM from NVIDIA is a research-focused tool for developing and training large-scale language models with transformer architectures, emphasizing efficient parallelism across multiple GPUs.

Markdown twin · horovod alternatives · Megatron-LM alternatives

GraphCanon updated 2w

horovod logo

horovod

horovod/horovod

★ 15kpushed Jul 29, 2026
vs
Megatron-LM logo

Megatron-LM

NVIDIA/Megatron-LM

★ 17kpushed Aug 6, 2026

Trust & integrity

SignalhorovodMegatron-LM
Maintenance
Archived (4d since push)
As of 3w · github_public_v1
Very active (0d since push)
As of 2w · github_public_v1
Provenance
Not a fork · Organization account
As of 3w · github_public_v1
Not a fork · Organization account
As of 2w · github_public_v1
OSV dependency advisories
No lockfile (source not queried)
As of 1mo · osv@v1
No lockfile (source not queried)
As of 1mo · osv@v1
deps.dev advisories
No lockfile (source not queried)
As of 3w · deps.dev@v1
Not queried
deps.dev@v1
OpenSSF Scorecard
Published findings
As of 1mo · openssf-scorecard@v1
Not queried
openssf-scorecard@v1
horovod trust reportMegatron-LM trust reportTrust methodology

Tagline

horovod
Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
Megatron-LM
Ongoing research training transformer models at scale

Stars

horovod
15k
Megatron-LM
17k

Forks

horovod
2.2k
Megatron-LM
4.3k

Open issues

horovod
406
Megatron-LM
1.1k

Language

horovod
Python
Megatron-LM
Python

Adopt for

horovod
Simplify distributed deep learning training for TensorFlow, Keras, PyTorch, and MXNet with minimal code changes.
Megatron-LM
Megatron-LM from NVIDIA is a research-focused tool for developing and training large-scale language models with transformer architectures, emphasizing efficient parallelism across multiple GPUs.

Persona

horovod
-
Megatron-LM
-

Runtime

horovod
-
Megatron-LM
-

License

horovod
Other
Megatron-LM
Other

Last pushed

horovod
Jul 29, 2026
Megatron-LM
Aug 6, 2026

Categories

horovod
Model Training
Megatron-LM
Model Training

Trust and health

Maintenance

horovod
Archived (8%)
Megatron-LM
Very active (96%)

Days since push

horovod
4d
Megatron-LM
0d

Archived on GitHub

horovod
Yes
Megatron-LM
No

Open issues (now)

horovod
406
Megatron-LM
1.1k

Stars delta

horovod
Unknown
Megatron-LM
+353 (30d)

Open issues delta

horovod
Unknown
Megatron-LM
+122 (30d)

deps.dev advisories

horovod
No lockfile (source not queried)
Megatron-LM
Not queried

OpenSSF Scorecard

horovod
Published findings
Megatron-LM
Not queried

Full report

horovod
Trust report
Megatron-LM
Trust report

Choose horovod if…

  • Tags unique to horovod: deep-learning, distributed-training, keras, mxnet.
  • When you need to scale your training across multiple GPUs or nodes with little modification to existing scripts.
  • Leaner open-issue backlog (406).

When NOT to use horovod

  • Avoid when extensive customization beyond core training is needed, as Horovod simplifies processes which might limit flexibility.
  • Not recommended if your project relies heavily on specific features not well-supported in Horovod's integration with frameworks like TensorFlow or PyTorch.
GitHubDetails

Choose Megatron-LM if…

  • Requirements: Min 32 GB RAM; Requires NVIDIA GPUs for optimized performance. Non-GPU usage is not supported or recommended.; Installation from source can be resource-intensive and may require limiting parallel compilation jobs to avoid running out of memory..
  • Tags unique to Megatron-LM: large language models, model-para, transformers.
  • The tool is particularly beneficial when your project is GPU-centric and benefits from advanced parallelism techniques such as Tensor, Pipeline, Data, Expert, and Cluster Parallelisms (TP, PP, DP, EP,

When NOT to use Megatron-LM

  • Avoid Megatron-LM if your computational setup does not include NVIDIA GPUs as it leverages GPU-specific features and parallelisms that may not be available or efficient on non-NVIDIA hardware.
  • If you need portability across various hardware without depending on proprietary optimizations, other tools might better serve your needs.
GitHubDetails

Explore

horovod trust report →Megatron-LM trust report →Model Training category →All comparisonsStack workflowsTrending tools

Sources

Every stat on this page traces to a dated GitHub sync, license file, enrichment field, or trust scan.

GitHub stars on cards: horovod 15k · Megatron-LM 17k (synced Aug 3, 2026).

Common questions

What is the difference between horovod and Megatron-LM?
horovod: Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.. Megatron-LM: Ongoing research training transformer models at scale. See the comparison table for live GitHub stats and shared categories.
When should I choose horovod over Megatron-LM?
Choose horovod over Megatron-LM when Tags unique to horovod: deep-learning, distributed-training, keras, mxnet; When you need to scale your training across multiple GPUs or nodes with little modification to existing scripts; Leaner open-issue backlog (406).
When should I choose Megatron-LM over horovod?
Choose Megatron-LM over horovod when Requirements: Min 32 GB RAM; Requires NVIDIA GPUs for optimized performance. Non-GPU usage is not supported or recommended.; Installation from source can be resource-intensive and may require limiting parallel compilation jobs to avoid running out of memory.; Tags unique to Megatron-LM: large language models, model-para, transformers; The tool is particularly beneficial when your project is GPU-centric and benefits from advanced parallelism techniques such as Tensor, Pipeline, Data, Expert, and Cluster Parallelisms (TP, PP, DP, EP,.
When should I avoid horovod?
Avoid when extensive customization beyond core training is needed, as Horovod simplifies processes which might limit flexibility. Not recommended if your project relies heavily on specific features not well-supported in Horovod's integration with frameworks like TensorFlow or PyTorch.
When should I avoid Megatron-LM?
Avoid Megatron-LM if your computational setup does not include NVIDIA GPUs as it leverages GPU-specific features and parallelisms that may not be available or efficient on non-NVIDIA hardware. If you need portability across various hardware without depending on proprietary optimizations, other tools might better serve your needs.
Is horovod or Megatron-LM more popular on GitHub?
Megatron-LM has more GitHub stars (17,341 vs 14,695). Stars measure visibility, not whether either tool fits your constraints.
Are horovod and Megatron-LM open source?
Yes - both are open-source projects on GitHub (horovod: Other, Megatron-LM: Other).
Where can I find alternatives to horovod or Megatron-LM?
GraphCanon lists graph-backed alternatives at horovod alternatives and Megatron-LM alternatives (horovod markdown twin, Megatron-LM markdown twin), ranked by typed relationship edges rather than popularity votes.
Is there a machine-readable version of this comparison?
Yes. The markdown twin at this comparison mirrors this page for agents and LLM crawlers, with the same stats table and FAQ answers.
Which is better maintained, horovod or Megatron-LM?
horovod: Archived. Megatron-LM: Very active. Compare maintenance labels, days since push, and release cadence in the trust section below - stars alone do not measure maintenance.
Where are the full trust reports for horovod and Megatron-LM?
GraphCanon publishes per-repo trust reports with dated maintenance, provenance, and scan summaries: horovod trust report; Megatron-LM trust report.

Was this helpful?

Anonymous feedback helps us improve pages and translations.