Home/Compare/awesome-llm-human-preference-datasets vs Open-LLM-Leaderboard

Comparison

awesome-llm-human-preference-datasets vs Open-LLM-Leaderboard

Verdict

Unverified catalog guidance: awesome-llm-human-preference-datasets: awesome-llm-human-preference-datasets is an open-source repository that curates a collection of human preference datasets for fine-tuning large language models (LLMs), with a focus on reinforcement learning with human反馈被. Open-LLM-Leaderboard: Open-LLM-Leaderboard evaluates large language models on open-style questions using a GPT-4-based evaluator and aggregates results in an accessible leaderboard format.

Markdown twin · awesome-llm-human-preference-datasets alternatives · Open-LLM-Leaderboard alternatives

GraphCanon updated Oct 19, 2026

awesome-llm-human-preference-datasets logo

awesome-llm-human-preference-datasets

glgh/awesome-llm-human-preference-datasets

★ 394pushed Oct 4, 2023
vs
Open-LLM-Leaderboard logo

Open-LLM-Leaderboard

VILA-Lab/Open-LLM-Leaderboard

★ 53pushed Jun 27, 2024

Trust & integrity

Signalawesome-llm-human-preference-datasetsOpen-LLM-Leaderboard
Maintenance
Dormant (1102d since push)
As of Oct 11, 2026 · github_public_v1
Dormant (843d since push)
As of Oct 19, 2026 · github_public_v1
Provenance
Not a fork · Personal account
As of Oct 11, 2026 · github_public_v1
Not a fork · Organization account
As of Oct 19, 2026 · github_public_v1
OSV dependency advisories
No lockfile (source not queried)
As of Jul 11, 2026 · osv@v1
No lockfile (source not queried)
As of Jul 15, 2026 · osv@v1
deps.dev advisories
Not queried
deps.dev@v1
Not queried
deps.dev@v1
OpenSSF Scorecard
Not queried
openssf-scorecard@v1
Not queried
openssf-scorecard@v1

Tagline

awesome-llm-human-preference-datasets
Curated list of Human Preference Datasets for LLM fine-tuning, RLHF, and eval
Open-LLM-Leaderboard
Tracks LLM performance on open-style questions

Stars

awesome-llm-human-preference-datasets
394
Open-LLM-Leaderboard
53

Forks

awesome-llm-human-preference-datasets
19
Open-LLM-Leaderboard
7

Open issues

awesome-llm-human-preference-datasets
0
Open-LLM-Leaderboard
1

Language

awesome-llm-human-preference-datasets
-
Open-LLM-Leaderboard
Python

Adopt for

awesome-llm-human-preference-datasets
Unverified catalog guidance: awesome-llm-human-preference-datasets is an open-source repository that curates a collection of human preference datasets for fine-tuning large language models (LLMs), with a focus on reinforcement learning with human反馈被
Open-LLM-Leaderboard
Unverified catalog guidance: Open-LLM-Leaderboard evaluates large language models on open-style questions using a GPT-4-based evaluator and aggregates results in an accessible leaderboard format.

Persona

awesome-llm-human-preference-datasets
-
Open-LLM-Leaderboard
-

Runtime

awesome-llm-human-preference-datasets
-
Open-LLM-Leaderboard
-

License

awesome-llm-human-preference-datasets
MIT
Open-LLM-Leaderboard
CC-BY-4.0

Last pushed

awesome-llm-human-preference-datasets
Oct 4, 2023
Open-LLM-Leaderboard
Jun 27, 2024

Categories

awesome-llm-human-preference-datasets
Evaluation & Observability, Model Training
Open-LLM-Leaderboard
Evaluation & Observability

Trust and health

Days since push

awesome-llm-human-preference-datasets
1102d
Open-LLM-Leaderboard
843d

Open issues (recorded)

awesome-llm-human-preference-datasets
0
Open-LLM-Leaderboard
1

Stars delta

awesome-llm-human-preference-datasets
+3 (30d)
Open-LLM-Leaderboard
0 (30d)

Owner type

awesome-llm-human-preference-datasets
User
Open-LLM-Leaderboard
Organization

Full report

awesome-llm-human-preference-datasets
Trust report
Open-LLM-Leaderboard
Trust report

Choose awesome-llm-human-preference-datasets if…

  • License: awesome-llm-human-preference-datasets is MIT, Open-LLM-Leaderboard is CC-BY-4.0.
  • Tags unique to awesome-llm-human-preference-datasets: awesome-list, datasets, eval, human-preferences.
  • Also covers Model Training.
  • Unverified catalog guidance: 当你需要对大型语言模型(LLM)进行微调,并希望使用经过人类评估的数据集来增强模型性能,尤其是在强化学习场景中时。

When NOT to use awesome-llm-human-preference-datasets

  • Unverified catalog guidance: NLP,LLM、,。

Choose Open-LLM-Leaderboard if…

  • License: Open-LLM-Leaderboard is CC-BY-4.0, awesome-llm-human-preference-datasets is MIT.
  • Tags unique to Open-LLM-Leaderboard: leaderboard, llm-evaluation, model-performance-tracking, open-style-questions.
  • Unverified catalog guidance: You need to evaluate your LLM's performance on open-ended, human-like question formats across multiple datasets without setting up the evaluation process yourself.

When NOT to use Open-LLM-Leaderboard

  • Unverified catalog guidance: You are seeking evaluations solely based on closed-response or multiple-choice questions where specific answers can be easily verified by non-LLM means.
  • Unverified catalog guidance: Your project has constraints against using commercial LLMs like GPT-4 for evaluation due to cost, licensing issues, or the need for open-source alternatives.

Explore

Sources

Every stat on this page traces to a dated GitHub sync, license file, enrichment field, or trust scan.

GitHub stars on cards: awesome-llm-human-preference-datasets 394 · Open-LLM-Leaderboard 53 (synced Oct 11, 2026).

Common questions

What is the difference between awesome-llm-human-preference-datasets and Open-LLM-Leaderboard?
awesome-llm-human-preference-datasets: Curated list of Human Preference Datasets for LLM fine-tuning, RLHF, and eval. Open-LLM-Leaderboard: Tracks LLM performance on open-style questions. See the comparison table for recorded GitHub metadata and shared categories.
When should I choose awesome-llm-human-preference-datasets over Open-LLM-Leaderboard?
For awesome-llm-human-preference-datasets, compare these recorded points with Open-LLM-Leaderboard: License: awesome-llm-human-preference-datasets is MIT, Open-LLM-Leaderboard is CC-BY-4.0; Tags unique to awesome-llm-human-preference-datasets: awesome-list, datasets, eval, human-preferences; Also covers Model Training; Unverified catalog guidance: 当你需要对大型语言模型(LLM)进行微调,并希望使用经过人类评估的数据集来增强模型性能,尤其是在强化学习场景中时。.
When should I choose Open-LLM-Leaderboard over awesome-llm-human-preference-datasets?
For Open-LLM-Leaderboard, compare these recorded points with awesome-llm-human-preference-datasets: License: Open-LLM-Leaderboard is CC-BY-4.0, awesome-llm-human-preference-datasets is MIT; Tags unique to Open-LLM-Leaderboard: leaderboard, llm-evaluation, model-performance-tracking, open-style-questions; Unverified catalog guidance: You need to evaluate your LLM's performance on open-ended, human-like question formats across multiple datasets without setting up the evaluation process yourself.
When should I avoid awesome-llm-human-preference-datasets?
Unverified catalog guidance: NLP,LLM、,。
When should I avoid Open-LLM-Leaderboard?
Unverified catalog guidance: You are seeking evaluations solely based on closed-response or multiple-choice questions where specific answers can be easily verified by non-LLM means. Unverified catalog guidance: Your project has constraints against using commercial LLMs like GPT-4 for evaluation due to cost, licensing issues, or the need for open-source alternatives.
Is awesome-llm-human-preference-datasets or Open-LLM-Leaderboard more popular on GitHub?
awesome-llm-human-preference-datasets has more recorded GitHub stars (394 vs 53). Stars measure visibility, not whether either tool fits your constraints.
Which licenses are recorded for awesome-llm-human-preference-datasets and Open-LLM-Leaderboard?
awesome-llm-human-preference-datasets: MIT. Open-LLM-Leaderboard: CC-BY-4.0. Check each repository's current license and terms before use. Public GitHub hosting alone does not establish open-source licensing.
Where can I find alternatives to awesome-llm-human-preference-datasets or Open-LLM-Leaderboard?
GraphCanon lists candidates at awesome-llm-human-preference-datasets alternatives and Open-LLM-Leaderboard alternatives (awesome-llm-human-preference-datasets markdown twin, Open-LLM-Leaderboard markdown twin). The discovery order uses stored relationship proposals and shared categories; it is not a verified replacement ranking.
Is there a machine-readable version of this comparison?
Yes. The markdown twin at this comparison mirrors this page for agents and LLM crawlers, with the same stats table and FAQ answers.
Which is better maintained, awesome-llm-human-preference-datasets or Open-LLM-Leaderboard?
awesome-llm-human-preference-datasets: Dormant. Open-LLM-Leaderboard: Dormant. Compare maintenance labels, days since push, and release cadence in the trust section below - stars alone do not measure maintenance.
Where are the full trust reports for awesome-llm-human-preference-datasets and Open-LLM-Leaderboard?
GraphCanon publishes per-repo trust reports with dated maintenance, provenance, and scan summaries: awesome-llm-human-preference-datasets trust report; Open-LLM-Leaderboard trust report.

Was this helpful?

Anonymous feedback helps us improve pages and translations.