Home/Compare/awesome-llm-human-preference-datasets vs Open-LLM-Leaderboard

Comparison

awesome-llm-human-preference-datasets vs Open-LLM-Leaderboard

Verdict

Pick awesome-llm-human-preference-datasets if awesome-llm-human-preference-datasets is an open-source repository that curates a collection of human preference datasets for fine-tuning large language models (LLMs), with a focus on reinforcement learning with human反馈被; pick Open-LLM-Leaderboard if open-LLM-Leaderboard evaluates large language models on open-style questions using a GPT-4-based evaluator and aggregates results in an accessible leaderboard format.

Markdown twin · awesome-llm-human-preference-datasets alternatives · Open-LLM-Leaderboard alternatives

GraphCanon updated Sep 20, 2026

12views this month

awesome-llm-human-preference-datasets logo

awesome-llm-human-preference-datasets

glgh/awesome-llm-human-preference-datasets

391pushed Oct 4, 2023
vs
Open-LLM-Leaderboard logo

Open-LLM-Leaderboard

VILA-Lab/Open-LLM-Leaderboard

53pushed Jun 27, 2024

Trust & integrity

Signalawesome-llm-human-preference-datasetsOpen-LLM-Leaderboard
Maintenance
Dormant (1067d since push)
As of Sep 6, 2026 · github_public_v1
Dormant (804d since push)
As of Sep 10, 2026 · github_public_v1
Provenance
Not a fork · Personal account
As of Sep 6, 2026 · github_public_v1
Not a fork · Organization account
As of Sep 10, 2026 · github_public_v1
OSV dependency advisories
No lockfile (source not queried)
As of Jul 11, 2026 · osv@v1
No lockfile (source not queried)
As of Jul 15, 2026 · osv@v1
deps.dev advisories
Not queried
deps.dev@v1
Not queried
deps.dev@v1
OpenSSF Scorecard
Not queried
openssf-scorecard@v1
Not queried
openssf-scorecard@v1

Tagline

awesome-llm-human-preference-datasets
Curated list of Human Preference Datasets for LLM fine-tuning, RLHF, and eval
Open-LLM-Leaderboard
Tracks LLM performance on open-style questions

Stars

awesome-llm-human-preference-datasets
391
Open-LLM-Leaderboard
53

Forks

awesome-llm-human-preference-datasets
19
Open-LLM-Leaderboard
7

Open issues

awesome-llm-human-preference-datasets
0
Open-LLM-Leaderboard
1

Language

awesome-llm-human-preference-datasets
-
Open-LLM-Leaderboard
Python

Adopt for

awesome-llm-human-preference-datasets
awesome-llm-human-preference-datasets is an open-source repository that curates a collection of human preference datasets for fine-tuning large language models (LLMs), with a focus on reinforcement learning with human反馈被
Open-LLM-Leaderboard
Open-LLM-Leaderboard evaluates large language models on open-style questions using a GPT-4-based evaluator and aggregates results in an accessible leaderboard format.

Persona

awesome-llm-human-preference-datasets
-
Open-LLM-Leaderboard
-

Runtime

awesome-llm-human-preference-datasets
-
Open-LLM-Leaderboard
-

License

awesome-llm-human-preference-datasets
MIT
Open-LLM-Leaderboard
CC-BY-4.0

Last pushed

awesome-llm-human-preference-datasets
Oct 4, 2023
Open-LLM-Leaderboard
Jun 27, 2024

Categories

awesome-llm-human-preference-datasets
Evaluation & Observability, Model Training
Open-LLM-Leaderboard
Evaluation & Observability

Trust and health

Days since push

awesome-llm-human-preference-datasets
1067d
Open-LLM-Leaderboard
804d

Open issues (now)

awesome-llm-human-preference-datasets
0
Open-LLM-Leaderboard
1

Stars delta

awesome-llm-human-preference-datasets
+1 (30d)
Open-LLM-Leaderboard
0 (30d)

Owner type

awesome-llm-human-preference-datasets
User
Open-LLM-Leaderboard
Organization

Full report

awesome-llm-human-preference-datasets
Trust report
Open-LLM-Leaderboard
Trust report

Choose awesome-llm-human-preference-datasets if…

  • License: awesome-llm-human-preference-datasets is MIT, Open-LLM-Leaderboard is CC-BY-4.0.
  • Tags unique to awesome-llm-human-preference-datasets: awesome-list, datasets, eval, human-preferences.
  • Also covers Model Training.
  • 当你需要对大型语言模型(LLM)进行微调,并希望使用经过人类评估的数据集来增强模型性能,尤其是在强化学习场景中时。

When NOT to use awesome-llm-human-preference-datasets

  • NLP,LLM、,。

Choose Open-LLM-Leaderboard if…

  • License: Open-LLM-Leaderboard is CC-BY-4.0, awesome-llm-human-preference-datasets is MIT.
  • Tags unique to Open-LLM-Leaderboard: leaderboard, llm-evaluation, model-performance-tracking, open-style-questions.
  • You need to evaluate your LLM's performance on open-ended, human-like question formats across multiple datasets without setting up the evaluation process yourself.

When NOT to use Open-LLM-Leaderboard

  • You are seeking evaluations solely based on closed-response or multiple-choice questions where specific answers can be easily verified by non-LLM means.
  • Your project has constraints against using commercial LLMs like GPT-4 for evaluation due to cost, licensing issues, or the need for open-source alternatives.

Explore

Sources

Every stat on this page traces to a dated GitHub sync, license file, enrichment field, or trust scan.

GitHub stars on cards: awesome-llm-human-preference-datasets 391 · Open-LLM-Leaderboard 53 (synced Sep 20, 2026).

Common questions

What is the difference between awesome-llm-human-preference-datasets and Open-LLM-Leaderboard?
awesome-llm-human-preference-datasets: Curated list of Human Preference Datasets for LLM fine-tuning, RLHF, and eval. Open-LLM-Leaderboard: Tracks LLM performance on open-style questions. See the comparison table for live GitHub stats and shared categories.
When should I choose awesome-llm-human-preference-datasets over Open-LLM-Leaderboard?
Choose awesome-llm-human-preference-datasets over Open-LLM-Leaderboard when License: awesome-llm-human-preference-datasets is MIT, Open-LLM-Leaderboard is CC-BY-4.0; Tags unique to awesome-llm-human-preference-datasets: awesome-list, datasets, eval, human-preferences; Also covers Model Training; 当你需要对大型语言模型(LLM)进行微调,并希望使用经过人类评估的数据集来增强模型性能,尤其是在强化学习场景中时。.
When should I choose Open-LLM-Leaderboard over awesome-llm-human-preference-datasets?
Choose Open-LLM-Leaderboard over awesome-llm-human-preference-datasets when License: Open-LLM-Leaderboard is CC-BY-4.0, awesome-llm-human-preference-datasets is MIT; Tags unique to Open-LLM-Leaderboard: leaderboard, llm-evaluation, model-performance-tracking, open-style-questions; You need to evaluate your LLM's performance on open-ended, human-like question formats across multiple datasets without setting up the evaluation process yourself.
When should I avoid awesome-llm-human-preference-datasets?
NLP,LLM、,。
When should I avoid Open-LLM-Leaderboard?
You are seeking evaluations solely based on closed-response or multiple-choice questions where specific answers can be easily verified by non-LLM means. Your project has constraints against using commercial LLMs like GPT-4 for evaluation due to cost, licensing issues, or the need for open-source alternatives.
Is awesome-llm-human-preference-datasets or Open-LLM-Leaderboard more popular on GitHub?
awesome-llm-human-preference-datasets has more GitHub stars (391 vs 53). Stars measure visibility, not whether either tool fits your constraints.
Are awesome-llm-human-preference-datasets and Open-LLM-Leaderboard open source?
Yes - both are open-source projects on GitHub (awesome-llm-human-preference-datasets: MIT, Open-LLM-Leaderboard: CC-BY-4.0).
Where can I find alternatives to awesome-llm-human-preference-datasets or Open-LLM-Leaderboard?
GraphCanon lists graph-backed alternatives at awesome-llm-human-preference-datasets alternatives and Open-LLM-Leaderboard alternatives (awesome-llm-human-preference-datasets markdown twin, Open-LLM-Leaderboard markdown twin), ranked by typed relationship edges rather than popularity votes.
Is there a machine-readable version of this comparison?
Yes. The markdown twin at this comparison mirrors this page for agents and LLM crawlers, with the same stats table and FAQ answers.
Which is better maintained, awesome-llm-human-preference-datasets or Open-LLM-Leaderboard?
awesome-llm-human-preference-datasets: Dormant. Open-LLM-Leaderboard: Dormant. Compare maintenance labels, days since push, and release cadence in the trust section below - stars alone do not measure maintenance.
Where are the full trust reports for awesome-llm-human-preference-datasets and Open-LLM-Leaderboard?
GraphCanon publishes per-repo trust reports with dated maintenance, provenance, and scan summaries: awesome-llm-human-preference-datasets trust report; Open-LLM-Leaderboard trust report.

Was this helpful?

Anonymous feedback helps us improve pages and translations.