Home/Model Training/awesome-llm-human-preference-datasets
awesome-llm-human-preference-datasets logo

awesome-llm-human-preference-datasets

glgh/awesome-llm-human-preference-datasets

Curated list of Human Preference Datasets for LLM fine-tuning, RLHF, and eval

GraphCanon updated today · GitHub synced today

391
Stars
20
Forks
0
Open issues
8
Watchers
2y
Last push
MITCreated May 3, 2023

Trust & integrity

Full report
Maintenance
Dormant (1010d since push)
As of today · Source: github_public_v1
Provenance
Not a fork · Personal account
As of today · Source: github_public_v1
Security (OSV)
No lockfile
As of today · Source: none

Public GitHub metadata and optional OSV dependency scans. Signals, not a guarantee. Trust methodology.

Overview

A collection of datasets that are specifically curated for LLM instruction tuning, reinforcement learning with human feedback (RLHF), and evaluation. Each dataset includes human-rated preferences over model responses or generated text.

Capability facts

No sourced capability facts yet. Facts appear after ingest scans repo manifests (Dockerfile, package.json, MCP configs).

Categories

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Works with ChatGPTChatGPT

Source: README excerpt (regex_v1, Jul 11, 2026)

[**Human ChatGPT Comparison Corpus (HC3)**](https://huggingface.co/datasets/Hello-SimpleAI/HC3)
Source link

Tags

README

Awesome Human Preference Datasets for LLM 🧑❤️🤖

A curated list of open source Human Preference datasets for LLM instruction-tuning, RLHF and evaluation.

For general NLP datasets and text corpora, check out this awesome list.

Datasets

OpenAI WebGPT Comparisons

  • 20k comparisons where each example comprises a question, a pair of model answers, and human-rated preference scores for each answer.
  • RLHF dataset used to train the OpenAI WebGPT reward model.

OpenAI Summarization

Anthropic Helpfulness and Harmlessness Dataset (HH-RLHF)

  • In total 170k human preference comparisons, including human preference data collected for Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback and human-generated red teaming data from Red Teaming Language Models to Reduce Harms, divided into 3 sub-datasets:
    • A base dataset using a context-distilled 52B model, with 44k helpfulness comparisons and 42k red-teaming (harmlessness) comparisons.
    • A RS dataset of 52k helpfulness comparisons and 2k red-teaming comparisons using rejection sampling models, where rejection sampling used a preference model trained on the base dataset.
    • An iterated online dataset including data from RLHF models, updated weekly over five weeks, with 22k helpfulness comparisons.

OpenAssistant Conversations Dataset (OASST1)

  • A human-generated, human-annotated assistant-style conversation corpus consisting of 161k messages in 35 languages, annotated with 461k quality ratings, resulting in 10k+ fully annotated conversation trees.

Stanford Human Preferences Dataset (SHP)

  • 385K collective human preferences over responses to questions/instructions in 18 domains for training RLHF reward models and NLG evaluation models. Datasets collected from Reddit.

Reddit ELI5

  • 270k examples of questions, answers and scores collected from 3 Q&A subreddits.

Human ChatGPT Comparison Corpus (HC3)

  • 60k human answers and 27K ChatGPT answers for around 24K questions.
  • Sibling dataset available for Chinese.

HuggingFace H4 StackExchange Preference Dataset

  • 10 million questions (with >= 2 answers) and answers (scored based on vote count) from Stackoverflow.

ShareGPT.com

  • 90k (as of April 2023) user-uploaded ChatGPT interactions.
  • To access the data using ShareGPT's API, see documentation here The ShareGPT API is currently disabled ("due to excess traffic").
  • Precompliled datasets on HuggingFace.

Alpaca

  • 52k instructions and demonstrations generated by OpenAI's text-davinci-003 engine for self-instruct training.

GPT4All

  • 1M prompt-response pairs colleced using GPT-3.5-Turbo API in March 2