--- title: "awesome-RLHF" type: "tool" slug: "opendilab-awesome-rlhf" canonical_url: "https://www.graphcanon.com/tools/opendilab-awesome-rlhf" github_url: "https://github.com/opendilab/awesome-RLHF" homepage_url: null stars: 4409 forks: 254 primary_language: null license: "Apache-2.0" categories: ["developer-tools"] tags: ["reinforcement-learning", "deep-learning", "rlhf", "large-language-models", "deep-reinforcement-learning", "human-feedback"] updated_at: "2026-07-07T18:41:05.716228+00:00" --- # awesome-RLHF > Repository for RLHF resources with papers and codebases. A curated collection of research papers, codebases, datasets, blogs, and books related to Reinforcement Learning with Human Feedback (RLHF) in various applications such as large language models and video games. ## Facts - Repository: https://github.com/opendilab/awesome-RLHF - Stars: 4,409 · Forks: 254 · Open issues: 4 · Watchers: 61 - License: Apache-2.0 - Last pushed: 2026-05-20T12:56:15+00:00 ## Categories - [Developer Tools](/categories/developer-tools.md) ## Tags reinforcement-learning, deep-learning, rlhf, large-language-models, deep-reinforcement-learning, human-feedback ## Related tools - [ECC](/tools/affaan-m-ecc.md) - The agent harness performance optimization system (★ 226,962) - [AutoGPT](/tools/significant-gravitas-autogpt.md) - AutoGPT: Build, Deploy, and Run AI Agents (★ 185,417) - [prompts.chat](/tools/f-prompts-chat.md) - The world's largest open-source prompt library for AI (★ 165,019) - [JavaGuide](/tools/snailclimb-javaguide.md) - Snailclimb/JavaGuide: 面试 & 后端通用面试指南，覆盖计算机基础、数据库、分布式、高并发、系统设计与 AI 应用开发 (★ 156,863) - [browser-use](/tools/browser-use-browser-use.md) - 🌐 Make websites accessible for AI agents. Automate tasks online with ease. (★ 103,315) - [caveman](/tools/juliusbrussee-caveman.md) - Cuts 65% of tokens in AI coding agent responses. (★ 86,150) - [llm-course](/tools/mlabonne-llm-course.md) - Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks. (★ 80,726) - [OpenHands](/tools/openhands-openhands.md) - The self-hosted developer control center for coding agents and automations. (★ 79,805) ## README (excerpt) ```text # Awesome RLHF (RL with Human Feedback) This is a collection of research papers for **Reinforcement Learning with Human Feedback** (RLHF). And the repository will be continuously updated to track the frontier of RLHF. Welcome to follow and star! ## Table of Contents - [Awesome RLHF (RL with Human Feedback)](#awesome-rlhf-rl-with-human-feedback) - [Table of Contents](#table-of-contents) - [Overview of RLHF](#overview-of-rlhf) - [Detailed Explanation](#detailed-explanation) - [Papers](#papers) - [2026](#2026) - [2025](#2025) - [2024](#2024) - [2023](#2023) - [2022](#2022) - [2021](#2021) - [2020 and before](#2020-and-before) - [Codebases](#codebases) - [Dataset](#dataset) - [Blogs](#blogs) - [Books](#books) - [Other Language Support](#other-language-support) - [Contributing](#contributing) - [License](#license) ## Overview of RLHF The idea of RLHF is to use methods from reinforcement learning to directly optimize a language model with human feedback. RLHF has enabled language models to begin to align a model trained on a general corpus of text data to that of complex human values. - RLHF for Large Language Model (LLM) - RLHF for Video Game (e.g. Atari) ### Detailed Explanation **(The following section was automatically generated by ChatGPT)** RLHF typically refers to "Reinforcement Learning with Human Feedback". Reinforcement Learning (RL) is a type of machine learning that involves training an agent to make decisions based on feedback from its environment. In RLHF, the agent also receives feedback from humans in the form of ratings or evaluations of its actions, which can help it learn more quickly and accurately. RLHF is an active research area in artificial intelligence, with applications in fields such as robotics, gaming, and personalized recommendation systems. It seeks to address the challenges of RL in scenarios where the agent has limited access to feedback from the environment and requires human input to improve its performance. Reinforcement Learning with Human Feedback (RLHF) is a rapidly developing area of research in artificial intelligence, and there are several advanced techniques that have been developed to improve the performance of RLHF systems. Here are some examples: - `Inverse Reinforcement Learning (IRL)`: IRL is a technique that allows the agent to learn a reward function from human feedback, rather than relying on pre-defined reward functions. This makes it possible for the agent to learn from more complex feedback signals, such as demonstrations of desired behavior. - `Apprenticeship Learning`: Apprenticeship learning is a technique that combines IRL with supervised learning to enable the agent to learn from both human feedback and expert demonstrations. This can help the agent learn more quickly and effectively, as it is able to learn from both positive and negative feedback. - `Interactive Machine Learning (IML)`: IML is a technique that involves active interaction between the agent and the human expert, allowing the expert to provide feedback on the agent's actions in real-time. This can help the agent learn more quickly and efficiently, as it can receive feedback on its actions at each step of the learning process. - `Human-in-the-Loop Reinforcement Learning (HITLRL)`: HITLRL is a technique that involves integrating human feedback into the RL process at multiple levels, such as reward shaping, action selection, and policy optimization. This can help to improve the efficiency and effectiveness of the RLHF system by taking advantage of the strengths of both humans and machines. Here are some examples of Reinforcement Learning with Human Feedback (RLHF): - `Game Playing`: In game playing, human feedback can help the agent learn strategies and tactics that are effective in different game scenarios. For example, in the popular game of Go, human experts can provide feedback to the agent on its moves, helping it improve its ``` --- **Machine-readable endpoints** - JSON: [`/api/graphcanon/tools/opendilab-awesome-rlhf`](/api/graphcanon/tools/opendilab-awesome-rlhf) - LLM index: [/llms.txt](/llms.txt) - Full corpus: [/llms-full.txt](/llms-full.txt) _GraphCanon - The knowledge graph for AI development. https://www.graphcanon.com/_