---
title: "OpenRLHF vs LLMs-from-scratch"
type: "comparison"
canonical_url: "https://www.graphcanon.com/compare/openrlhf-openrlhf-vs-rasbt-llms-from-scratch"
tools: ["openrlhf-openrlhf", "rasbt-llms-from-scratch"]
---

# OpenRLHF vs LLMs-from-scratch

Neutral, constraint-first comparison with live GitHub stats.

| | [OpenRLHF](/tools/openrlhf-openrlhf.md) | [LLMs-from-scratch](/tools/rasbt-llms-from-scratch.md) |
| --- | --- | --- |
| Tagline | An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray | Implement a ChatGPT-like LLM in PyTorch from scratch |
| Stars | 9,759 | 98,715 |
| Forks | 981 | 15,148 |
| Open issues | 342 | 4 |
| Language | Python | Jupyter Notebook |
| License | Apache-2.0 | Other |
| Categories | Model Training, Developer Tools | Model Training, LLM Frameworks |

---

**Machine-readable endpoints**

- JSON: [`/api/graphcanon/graph?tool=openrlhf-openrlhf`](/api/graphcanon/graph?tool=openrlhf-openrlhf)
- LLM index: [/llms.txt](/llms.txt)
- Full corpus: [/llms-full.txt](/llms-full.txt)

_GraphCanon - The knowledge graph for AI development. https://www.graphcanon.com/_