Home/Evaluation & Observability/awesome-llm-human-preference-datasets
awesome-llm-human-preference-datasets logo

awesome-llm-human-preference-datasets

glgh/awesome-llm-human-preference-datasets

Curated list of Human Preference Datasets for LLM fine-tuning, RLHF, and eval

GraphCanon updated Oct 11, 2026 · GitHub synced Oct 11, 2026

93views this month

394 stars19 forksLast push Oct 4, 2023 MIT

Decision brief

awesome-llm-human-preference-datasets is an open-source repository that curates a collection of human preference datasets for fine-tuning large language models (LLMs), with a focus on reinforcement learning with human反馈被

Good fit when

  • 当你需要对大型语言模型(LLM)进行微调,并希望使用经过人类评估的数据集来增强模型性能,尤其是在强化学习场景中时。
  • 您正在寻找用于RLHF(Reinforcement Learning from Human Feedback)、训练或评估的高质量数据集,特别是那些已经通过了人类评价或反馈的数据集。

Avoid when

  • 如果您只关心一般的NLP任务和文本语料库,而不是特定于人类偏好评估的LLM微调、强化学习等方面,则可能这不是您需要寻求的数据集资源。
  • 如果您的项目不需要使用包含人类反馈的高级数据集进行训练或评估,而是专注于传统的机器学习模型,那么这个工具可能不适用于您。

Observed Jul 11, 2026 · Source: enrich:decision_facts

Verify the decision

Maintenance and security

Full trust report
Maintenance
Dormant (1102d since push)
As of Oct 11, 2026
Provenance
Not a fork · Personal account
As of Oct 11, 2026
Security (OSV)
No lockfile
As of Jul 11, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

git clone https://github.com/glgh/awesome-llm-human-preference-datasets

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

A collection of datasets that are specifically curated for LLM instruction tuning, reinforcement learning with human feedback (RLHF), and evaluation. Each dataset includes human-rated preferences over model responses or generated text.

Capability facts

No sourced capability facts yet. Facts appear after ingest scans repo manifests (Dockerfile, package.json, MCP configs).

Categories

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Works with ChatGPTChatGPT

Source: README excerpt (regex_v1, Oct 11, 2026)

[**Human ChatGPT Comparison Corpus (HC3)**](https://huggingface.co/datasets/Hello-SimpleAI/HC3)
Source link

Tags

README

Awesome Human Preference Datasets for LLM 🧑❤️🤖 A curated list of open source Human Preference datasets for LLM instruction tuning, RLHF and evaluation. For general NLP datasets and text corpora, check out this awesome list. Datasets OpenAI WebGPT Comparisons 20k comparisons whe...

For agents

This page has a .md twin and JSON over the API.

Was this helpful?

Anonymous feedback helps us improve pages and translations.