{"data":{"node":{"slug":"openrlhf-openrlhf","name":"OpenRLHF","tagline":"Scalable and High-performance Agentic RL Framework based on Ray","github_url":"https://github.com/OpenRLHF/OpenRLHF","owner":"OpenRLHF","repo":"OpenRLHF","owner_avatar_url":"https://avatars.githubusercontent.com/u/175771028?v=4","primary_language":"Python","stars":10014,"forks":1019,"topics":["large-language-models","proximal-policy-optimization","raylib","reinforcement-learning","reinforcement-learning-from-human-feedback","transformers","visual-language-models","vllm"],"archived":false,"github_pushed_at":"2026-09-17T05:49:37+00:00","maintenance_label":"Very active","stars_delta_30d":123,"url":"https://www.graphcanon.com/tools/openrlhf-openrlhf","markdown_url":"https://www.graphcanon.com/tools/openrlhf-openrlhf.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/openrlhf-openrlhf","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=openrlhf-openrlhf"},"categories":[{"slug":"inference-serving","name":"Inference & Serving","url":"https://www.graphcanon.com/categories/inference-serving","markdown_url":"https://www.graphcanon.com/categories/inference-serving.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/inference-serving"},{"slug":"model-training","name":"Model Training","url":"https://www.graphcanon.com/categories/model-training","markdown_url":"https://www.graphcanon.com/categories/model-training.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/model-training"}],"tags":[{"slug":"large-language-models","name":"large-language-models"},{"slug":"proximal-policy-optimization","name":"proximal-policy-optimization"},{"slug":"raylib","name":"raylib"},{"slug":"reinforcement-learning","name":"reinforcement learning"},{"slug":"reinforcement-learning-from-human-feedba","name":"reinforcement-learning-from-human-feedba"},{"slug":"transformers","name":"transformers"},{"slug":"visual-language-models","name":"visual-language-models"},{"slug":"vllm","name":"vllm"}],"edges":[{"type":"related","direction":"out","explanation":"Both platforms aim to work with LLMs and can be considered adjacent projects, but Onyx focuses more on a user-friendly AI chat interface.","successor_context":null,"tool":{"slug":"onyx-dot-app-onyx","name":"onyx","tagline":"Open Source AI Platform - AI Chat with advanced features that works with every LLM","github_url":"https://github.com/onyx-dot-app/onyx","owner":"onyx-dot-app","repo":"onyx","owner_avatar_url":"https://avatars.githubusercontent.com/u/131946000?v=4","primary_language":"Python","stars":32153,"forks":4477,"topics":["ai","ai-chat","chatgpt","chatui","enterprise-search","gen-ai","information-retrieval","llm","llm-ui","nextjs","python","rag","self-hosted","vector-search"],"archived":false,"github_pushed_at":"2026-09-18T05:39:36+00:00","maintenance_label":"Very active","stars_delta_30d":536,"url":"https://www.graphcanon.com/tools/onyx-dot-app-onyx","markdown_url":"https://www.graphcanon.com/tools/onyx-dot-app-onyx.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/onyx-dot-app-onyx","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=onyx-dot-app-onyx"}},{"type":"depends_on","direction":"out","explanation":"OpenRLHF is built on HuggingFace Transformers for seamless model loading and fine-tuning of pretrained models.","successor_context":null,"tool":{"slug":"huggingface-transformers","name":"transformers","tagline":"🤗 Transformers: state-of-the-art machine learning models for text, vision, audio, and multimodal models","github_url":"https://github.com/huggingface/transformers","owner":"huggingface","repo":"transformers","owner_avatar_url":"https://avatars.githubusercontent.com/u/25720743?v=4","primary_language":"Python","stars":166279,"forks":34619,"topics":["audio","deep-learning","deepseek","gemma","glm","hacktoberfest","llm","machine-learning","model-hub","natural-language-processing","nlp","pretrained-models","python","pytorch","pytorch-transformers","qwen","speech-recognition","transformer","vlm"],"archived":false,"github_pushed_at":"2026-09-18T08:16:29+00:00","maintenance_label":"Very active","stars_delta_30d":2158,"url":"https://www.graphcanon.com/tools/huggingface-transformers","markdown_url":"https://www.graphcanon.com/tools/huggingface-transformers.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/huggingface-transformers","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=huggingface-transformers"}},{"type":"related","direction":"out","explanation":"Both serve large language and multimodal models, but sglang is a serving framework while OpenRLHF focuses on RL optimization.","successor_context":null,"tool":{"slug":"sgl-project-sglang","name":"sglang","tagline":"SGLang is a high-performance serving framework for large language models and multimodal models.","github_url":"https://github.com/sgl-project/sglang","owner":"sgl-project","repo":"sglang","owner_avatar_url":"https://avatars.githubusercontent.com/u/147780389?v=4","primary_language":"Python","stars":36123,"forks":8969,"topics":["attention","blackwell","cuda","deepseek","diffusion","glm","gpt-oss","inference","llama","llm","minimax","moe","qwen","qwen-image","reinforcement-learning","transformer","vlm","wan"],"archived":false,"github_pushed_at":"2026-09-18T08:40:33+00:00","maintenance_label":"Very active","stars_delta_30d":4669,"url":"https://www.graphcanon.com/tools/sgl-project-sglang","markdown_url":"https://www.graphcanon.com/tools/sgl-project-sglang.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/sgl-project-sglang","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=sgl-project-sglang"}},{"type":"depends_on","direction":"out","explanation":"OpenRLHF uses vLLM to power high-throughput and memory-efficient sample generation, optimizing the RLHF training process.","successor_context":null,"tool":{"slug":"vllm-project-vllm","name":"vllm","tagline":"A high-throughput and memory-efficient inference and serving engine for LLMs","github_url":"https://github.com/vllm-project/vllm","owner":"vllm-project","repo":"vllm","owner_avatar_url":"https://avatars.githubusercontent.com/u/136984999?v=4","primary_language":"Python","stars":92075,"forks":22363,"topics":["amd","blackwell","cuda","deepseek","deepseek-v3","gpt","gpt-oss","inference","kimi","llama","llm","llm-serving","model-serving","moe","openai","pytorch","qwen","qwen3","tpu","transformer"],"archived":false,"github_pushed_at":"2026-09-18T07:28:54+00:00","maintenance_label":"Very active","stars_delta_30d":4228,"url":"https://www.graphcanon.com/tools/vllm-project-vllm","markdown_url":"https://www.graphcanon.com/tools/vllm-project-vllm.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/vllm-project-vllm","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=vllm-project-vllm"}},{"type":"depends_on","direction":"out","explanation":"OpenRLHF leverages Ray for efficient distributed scheduling, separating Actor, Reward, Reference, and Critic models across different GPUs.","successor_context":null,"tool":{"slug":"ray-project-ray","name":"ray","tagline":"Unified framework for scaling AI and Python applications","github_url":"https://github.com/ray-project/ray","owner":"ray-project","repo":"ray","owner_avatar_url":"https://avatars.githubusercontent.com/u/22125274?v=4","primary_language":"Python","stars":43863,"forks":8052,"topics":["data-science","deep-learning","deployment","distributed","hyperparameter-optimization","hyperparameter-search","large-language-models","llm","llm-inference","llm-serving","machine-learning","optimization","parallel","python","pytorch","ray","reinforcement-learning","rllib","serving","tensorflow"],"archived":false,"github_pushed_at":"2026-09-18T06:15:07+00:00","maintenance_label":"Very active","stars_delta_30d":337,"url":"https://www.graphcanon.com/tools/ray-project-ray","markdown_url":"https://www.graphcanon.com/tools/ray-project-ray.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/ray-project-ray","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=ray-project-ray"}}],"neighbours":[{"slug":"ray-project-ray","name":"ray","tagline":"Unified framework for scaling AI and Python applications","github_url":"https://github.com/ray-project/ray","owner":"ray-project","repo":"ray","owner_avatar_url":"https://avatars.githubusercontent.com/u/22125274?v=4","primary_language":"Python","stars":43863,"forks":8052,"topics":["data-science","deep-learning","deployment","distributed","hyperparameter-optimization","hyperparameter-search","large-language-models","llm","llm-inference","llm-serving","machine-learning","optimization","parallel","python","pytorch","ray","reinforcement-learning","rllib","serving","tensorflow"],"archived":false,"github_pushed_at":"2026-09-18T06:15:07+00:00","maintenance_label":"Active","url":"https://www.graphcanon.com/tools/ray-project-ray","markdown_url":"https://www.graphcanon.com/tools/ray-project-ray.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/ray-project-ray","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=ray-project-ray","shared_categories":["model-training","inference-serving"]},{"slug":"huggingface-open-r1","name":"open-r1","tagline":"Fully open reproduction of DeepSeek-R1","github_url":"https://github.com/huggingface/open-r1","owner":"huggingface","repo":"open-r1","owner_avatar_url":"https://avatars.githubusercontent.com/u/25720743?v=4","primary_language":"Python","stars":26477,"forks":2452,"topics":[],"archived":false,"github_pushed_at":"2026-10-02T03:57:56+00:00","maintenance_label":"Active","url":"https://www.graphcanon.com/tools/huggingface-open-r1","markdown_url":"https://www.graphcanon.com/tools/huggingface-open-r1.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/huggingface-open-r1","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=huggingface-open-r1","shared_categories":["model-training","inference-serving"]},{"slug":"verl-project-verl","name":"verl","tagline":"A Flexible and Efficient RL Post-Training Framework","github_url":"https://github.com/verl-project/verl","owner":"verl-project","repo":"verl","owner_avatar_url":"https://avatars.githubusercontent.com/u/212961691?v=4","primary_language":"Python","stars":23318,"forks":4500,"topics":[],"archived":false,"github_pushed_at":"2026-09-04T22:00:53+00:00","maintenance_label":"Steady","url":"https://www.graphcanon.com/tools/verl-project-verl","markdown_url":"https://www.graphcanon.com/tools/verl-project-verl.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/verl-project-verl","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=verl-project-verl","shared_categories":["model-training"]},{"slug":"huggingface-trl","name":"trl","tagline":"Train transformer language models with reinforcement learning","github_url":"https://github.com/huggingface/trl","owner":"huggingface","repo":"trl","owner_avatar_url":"https://avatars.githubusercontent.com/u/25720743?v=4","primary_language":"Python","stars":19336,"forks":3002,"topics":[],"archived":false,"github_pushed_at":"2026-09-18T06:20:19+00:00","maintenance_label":"Active","url":"https://www.graphcanon.com/tools/huggingface-trl","markdown_url":"https://www.graphcanon.com/tools/huggingface-trl.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/huggingface-trl","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=huggingface-trl","shared_categories":["model-training"]},{"slug":"woooodyy-llm-agent-paper-list","name":"LLM-Agent-Paper-List","tagline":"Must-read papers for LLM-based agents.","github_url":"https://github.com/WooooDyy/LLM-Agent-Paper-List","owner":"WooooDyy","repo":"LLM-Agent-Paper-List","owner_avatar_url":"https://avatars.githubusercontent.com/u/48242229?v=4","primary_language":null,"stars":8222,"forks":499,"topics":["agent","large-language-models","llm","nlp","survey"],"archived":false,"github_pushed_at":"2025-09-12T03:08:58+00:00","maintenance_label":"Dormant","url":"https://www.graphcanon.com/tools/woooodyy-llm-agent-paper-list","markdown_url":"https://www.graphcanon.com/tools/woooodyy-llm-agent-paper-list.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/woooodyy-llm-agent-paper-list","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=woooodyy-llm-agent-paper-list","shared_categories":["model-training"]},{"slug":"opendilab-awesome-rlhf","name":"awesome-RLHF","tagline":"A curated list of reinforcement learning with human feedback resources (continually updated)","github_url":"https://github.com/opendilab/awesome-RLHF","owner":"opendilab","repo":"awesome-RLHF","owner_avatar_url":"https://avatars.githubusercontent.com/u/86840398?v=4","primary_language":null,"stars":4422,"forks":258,"topics":["deep-learning","deep-reinforcement-learning","human-feedback","large-language-models","reinforcement-learning","rlhf"],"archived":false,"github_pushed_at":"2026-05-20T12:56:15+00:00","maintenance_label":"Slowing","url":"https://www.graphcanon.com/tools/opendilab-awesome-rlhf","markdown_url":"https://www.graphcanon.com/tools/opendilab-awesome-rlhf.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/opendilab-awesome-rlhf","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=opendilab-awesome-rlhf","shared_categories":["model-training"]},{"slug":"alibaba-roll","name":"ROLL","tagline":"Scaling Library for Reinforcement Learning with Large Language Models","github_url":"https://github.com/alibaba/ROLL","owner":"alibaba","repo":"ROLL","owner_avatar_url":"https://avatars.githubusercontent.com/u/1961952?v=4","primary_language":"Python","stars":3383,"forks":311,"topics":["agentic","rlhf","rlvr"],"archived":false,"github_pushed_at":"2026-09-06T01:30:14+00:00","maintenance_label":"Steady","url":"https://www.graphcanon.com/tools/alibaba-roll","markdown_url":"https://www.graphcanon.com/tools/alibaba-roll.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/alibaba-roll","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=alibaba-roll","shared_categories":["model-training"]},{"slug":"stanford-crfm-helm","name":"helm","tagline":"Holistic, reproducible and transparent evaluation of foundation models","github_url":"https://github.com/stanford-crfm/helm","owner":"stanford-crfm","repo":"helm","owner_avatar_url":"https://avatars.githubusercontent.com/u/75054807?v=4","primary_language":"Python","stars":2939,"forks":421,"topics":[],"archived":false,"github_pushed_at":"2026-09-01T01:33:19+00:00","maintenance_label":"Steady","url":"https://www.graphcanon.com/tools/stanford-crfm-helm","markdown_url":"https://www.graphcanon.com/tools/stanford-crfm-helm.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/stanford-crfm-helm","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=stanford-crfm-helm","shared_categories":[]},{"slug":"rath-team-openrath","name":"OpenRath","tagline":"An open-source runtime for dynamic multi-agent workflows","github_url":"https://github.com/Rath-Team/OpenRath","owner":"Rath-Team","repo":"OpenRath","owner_avatar_url":"https://avatars.githubusercontent.com/u/279513473?v=4","primary_language":"Python","stars":1139,"forks":59,"topics":["agent-framework","agentic-ai","ai-agents","anthropic","lllm-agent","llm","memory","model-context-protocol","multi-agent","multi-agent-systems","open-source","openai","provenance","python","runtime-state","sandbox","session-graph","session-state","workflow-orchestration"],"archived":false,"github_pushed_at":"2026-07-31T05:04:23+00:00","maintenance_label":"Steady","url":"https://www.graphcanon.com/tools/rath-team-openrath","markdown_url":"https://www.graphcanon.com/tools/rath-team-openrath.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/rath-team-openrath","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=rath-team-openrath","shared_categories":[]},{"slug":"salesforce-coderl","name":"CodeRL","tagline":"CodeRL: Combines pretrained models and reinforcement learning for code generation.","github_url":"https://github.com/salesforce/CodeRL","owner":"salesforce","repo":"CodeRL","owner_avatar_url":"https://avatars.githubusercontent.com/u/453694?v=4","primary_language":"Python","stars":576,"forks":69,"topics":["ai","codegeneration","languagemodel","machinelearning","programsynthesis","reinforcementlearning"],"archived":false,"github_pushed_at":"2026-06-02T18:14:33+00:00","maintenance_label":"Slowing","url":"https://www.graphcanon.com/tools/salesforce-coderl","markdown_url":"https://www.graphcanon.com/tools/salesforce-coderl.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/salesforce-coderl","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=salesforce-coderl","shared_categories":["model-training"]},{"slug":"joyce94-llm-rlhf-tuning","name":"LLM-RLHF-Tuning","tagline":"LLM Tuning with PEFT (SFT+RM+PPO+DPO with LoRA)","github_url":"https://github.com/Joyce94/LLM-RLHF-Tuning","owner":"Joyce94","repo":"LLM-RLHF-Tuning","owner_avatar_url":"https://avatars.githubusercontent.com/u/28557140?v=4","primary_language":"Python","stars":452,"forks":24,"topics":["fine-tuning","language-model","llama","llm","lora","peft","ppo","reinforcement-learning","rlhf"],"archived":false,"github_pushed_at":"2023-10-11T08:41:20+00:00","maintenance_label":"Dormant","url":"https://www.graphcanon.com/tools/joyce94-llm-rlhf-tuning","markdown_url":"https://www.graphcanon.com/tools/joyce94-llm-rlhf-tuning.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/joyce94-llm-rlhf-tuning","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=joyce94-llm-rlhf-tuning","shared_categories":["model-training"]},{"slug":"open-bias-open-bias","name":"open-bias","tagline":"One line of code to enforce, trace, and improve rule adherence for AI agents.","github_url":"https://github.com/open-bias/open-bias","owner":"open-bias","repo":"open-bias","owner_avatar_url":"https://avatars.githubusercontent.com/u/270147414?v=4","primary_language":"Python","stars":142,"forks":5,"topics":["agentic-ai","ai-audit","ai-compliance","ai-firewall","ai-governance","ai-guardrails","ai-policy","ai-safety","ai-security","content-safety","guardrails","llm-guardrails","llm-monitoring","llm-proxy","llm-safety","llm-security","policy-engine","prompt-injection","responsible-ai","rule-engine"],"archived":false,"github_pushed_at":"2026-05-23T05:54:44+00:00","maintenance_label":"Slowing","url":"https://www.graphcanon.com/tools/open-bias-open-bias","markdown_url":"https://www.graphcanon.com/tools/open-bias-open-bias.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/open-bias-open-bias","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=open-bias-open-bias","shared_categories":[]}]}}