{"data":{"slug":"glgh-awesome-llm-human-preference-datasets","name":"awesome-llm-human-preference-datasets","tagline":"Curated list of Human Preference Datasets for LLM fine-tuning, RLHF, and eval","github_url":"https://github.com/glgh/awesome-llm-human-preference-datasets","owner":"glgh","repo":"awesome-llm-human-preference-datasets","owner_avatar_url":"https://avatars.githubusercontent.com/u/16108776?v=4","primary_language":null,"stars":391,"forks":20,"topics":["awesome-list","datasets","eval","human-preferences","llm","machine-learning","nlp","rlhf"],"archived":false,"github_pushed_at":"2023-10-04T19:56:44+00:00","maintenance_label":"Dormant","url":"https://www.graphcanon.com/tools/glgh-awesome-llm-human-preference-datasets","markdown_url":"https://www.graphcanon.com/tools/glgh-awesome-llm-human-preference-datasets.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/glgh-awesome-llm-human-preference-datasets","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=glgh-awesome-llm-human-preference-datasets","description":"A curated list of Human Preference Datasets for LLM fine-tuning, RLHF, and eval.","homepage_url":null,"license":"MIT","open_issues":0,"watchers":8,"ai_summary":"A collection of datasets that are specifically curated for LLM instruction tuning, reinforcement learning with human feedback (RLHF), and evaluation. Each dataset includes human-rated preferences over model responses or generated text.","readme_excerpt":"# Awesome Human Preference Datasets for LLM 🧑❤️🤖\nA curated list of open source **Human Preference** datasets for LLM instruction-tuning, RLHF and evaluation.\n\nFor general NLP datasets and text corpora, check out [this](https://github.com/niderhoff/nlp-datasets) awesome list.\n\n\n## Datasets\n[**OpenAI WebGPT Comparisons**](https://huggingface.co/datasets/openai/webgpt_comparisons)\n- 20k comparisons where each example comprises a question, a pair of model answers, and human-rated preference scores for each answer. \n- RLHF dataset used to train the [OpenAI WebGPT](https://arxiv.org/abs/2112.09332) reward model.\n\n[**OpenAI Summarization**](https://huggingface.co/datasets/openai/summarize_from_feedback)\n- 64k text summarization examples including human-written responses and human-rated model responses. \n- RLHF dataset used in the [OpenAI Learning to Summarize from Human Feedback](https://arxiv.org/abs/2009.01325) paper.\n- Explore sample data [here](https://openaipublic.blob.core.windows.net/summarize-from-feedback/website/index.html#/tldr_comparisons).\n\n[**Anthropic Helpfulness and Harmlessness Dataset (HH-RLHF)**](https://huggingface.co/datasets/Anthropic/hh-rlhf) \n- In total 170k human preference comparisons, including human preference data collected for [Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback](https://arxiv.org/pdf/2204.05862.pdf) and human-generated red teaming data from [Red Teaming Language Models to Reduce Harms](https://arxiv.org/abs/2209.07858), divided into 3 sub-datasets:\n    - A **base** dataset using a context-distilled 52B model, with 44k helpfulness comparisons and 42k red-teaming (harmlessness) comparisons.\n    - A **RS** dataset of 52k helpfulness comparisons and 2k red-teaming comparisons using rejection sampling models, where rejection sampling used a preference model trained on the base dataset.\n    - An iterated **online** dataset including data from RLHF models, updated weekly over five weeks, with 22k helpfulness comparisons.\n\n[**OpenAssistant Conversations Dataset (OASST1)**](https://huggingface.co/datasets/OpenAssistant/oasst1)\n- A human-generated, human-annotated assistant-style conversation corpus consisting of 161k messages in 35 languages, annotated with 461k quality ratings, resulting in 10k+ fully annotated conversation trees. \n\n[**Stanford Human Preferences Dataset (SHP)**](https://huggingface.co/datasets/stanfordnlp/SHP) \n- 385K collective human preferences over responses to questions/instructions in 18 domains for training RLHF reward models and NLG evaluation models. Datasets collected from Reddit.\n\n[**Reddit ELI5**](https://huggingface.co/datasets/eli5)\n- 270k examples of questions, answers and scores collected from 3 Q&A subreddits.\n\n[**Human ChatGPT Comparison Corpus (HC3)**](https://huggingface.co/datasets/Hello-SimpleAI/HC3)\n- 60k human answers and 27K ChatGPT answers for around 24K questions.\n- Sibling dataset available for [Chinese](https://huggingface.co/datasets/Hello-SimpleAI/HC3-Chinese).\n\n[**HuggingFace H4 StackExchange Preference Dataset**](https://huggingface.co/datasets/HuggingFaceH4/stack-exchange-preferences)\n- 10 million questions (with >= 2 answers) and answers (scored based on vote count) from Stackoverflow. \n\n[**ShareGPT.com**](https://sharegpt.com/)\n- 90k (as of April 2023) user-uploaded ChatGPT interactions.\n- ~~To access the data using ShareGPT's API, see documentation [here](https://github.com/domeccleston/sharegpt#rest-api)~~ The ShareGPT API is currently disabled (\"due to excess traffic\"). \n- [Precompliled datasets](https://huggingface.co/datasets?sort=downloads&search=sharegpt) on HuggingFace.\n\n[**Alpaca**](https://huggingface.co/datasets/tatsu-lab/alpaca)\n- 52k instructions and demonstrations generated by OpenAI's text-davinci-003 engine for _self-instruct_ training.\n\n[**GPT4All**](https://huggingface.co/datasets/nomic-ai/gpt4all_prompt_generations)\n- 1M prompt-response pairs colleced using GPT-3.5-Turbo API in March 2","github_created_at":"2023-05-03T16:48:10+00:00","created_at":"2026-07-11T10:32:09.576256+00:00","updated_at":"2026-07-11T11:27:25.005843+00:00","categories":[{"slug":"evaluation-observability","name":"Evaluation & Observability","url":"https://www.graphcanon.com/categories/evaluation-observability","markdown_url":"https://www.graphcanon.com/categories/evaluation-observability.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/evaluation-observability"},{"slug":"model-training","name":"Model Training","url":"https://www.graphcanon.com/categories/model-training","markdown_url":"https://www.graphcanon.com/categories/model-training.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/model-training"}],"tags":[{"slug":"awesome-list","name":"awesome-list"},{"slug":"datasets","name":"datasets"},{"slug":"eval","name":"eval"},{"slug":"human-preferences","name":"human-preferences"},{"slug":"llm","name":"llm"},{"slug":"machine-learning","name":"machine-learning"},{"slug":"nlp","name":"nlp"},{"slug":"rlhf","name":"rlhf"}],"trust":{"provenance":{"is_fork":false,"github_id":635880783,"owner_type":"User","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-07-11T10:32:10.353Z","maintenance":{"label":"Dormant","score":18,"methodology":"github_public_v1","releases_90d":0,"days_since_push":1010,"last_release_at":null},"security_summary":{"status":"no_lockfile","scanner":null,"low_count":0,"high_count":0,"last_scan_at":"2026-07-11T10:32:11.326Z","medium_count":0,"scan_profile":"none","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-07-11T11:26:55.632Z"},"license_spdx":{"value":"MIT","source":"github.license","observed_at":"2026-07-11T11:26:55.632Z"}},"decision_facts":{"hosting":null,"pricing":null,"requirements":null,"constraints":null,"when_to_use":["当你需要对大型语言模型（LLM）进行微调，并希望使用经过人类评估的数据集来增强模型性能，尤其是在强化学习场景中时。","您正在寻找用于RLHF（Reinforcement Learning from Human Feedback）、训练或评估的高质量数据集，特别是那些已经通过了人类评价或反馈的数据集。"],"when_not_to_use":["如果您只关心一般的NLP任务和文本语料库，而不是特定于人类偏好评估的LLM微调、强化学习等方面，则可能这不是您需要寻求的数据集资源。","如果您的项目不需要使用包含人类反馈的高级数据集进行训练或评估，而是专注于传统的机器学习模型，那么这个工具可能不适用于您。"],"source":"enrich:decision_facts","observed_at":"2026-07-11T11:27:24.701Z"},"constraint_facets":null,"decision_summary":[{"label":"Adopt for","value":"awesome-llm-human-preference-datasets is an open-source repository that curates a collection of human preference datasets for fine-tuning large language models (LLMs), with a focus on reinforcement learning with human反馈被"}]}}