Comparison
LlamaFactory vs qa_metrics
Verdict
Pick LlamaFactory when license: LlamaFactory is Apache-2.0, qa_metrics is MIT; pick qa_metrics when license: qa_metrics is MIT, LlamaFactory is Apache-2.0.
Markdown twin · LlamaFactory alternatives · qa_metrics alternatives
GraphCanon updated today
vs
Trust & integrity
| Signal | LlamaFactory | qa_metrics |
|---|---|---|
| Maintenance | Very active (0d since push) As of 4d · github_public_v1 | Slowing (361d since push) As of today · github_public_v1 |
| Provenance | Not a fork · Personal account As of 4d · github_public_v1 | Not a fork · Personal account As of today · github_public_v1 |
| OSV dependency advisories | No lockfile (source not queried) As of 4d · osv@v1 | No lockfile (source not queried) As of today · osv@v1 |
| deps.dev advisories | Not queried deps.dev@v1 | Not queried deps.dev@v1 |
| OpenSSF Scorecard | Not queried openssf-scorecard@v1 | Not queried openssf-scorecard@v1 |
Tagline
- LlamaFactory
- Unified Efficient Fine-Tuning of 100+ LLMs & VLMs
- qa_metrics
- An easy python package to run quick basic QA evaluations. This package includes standardized QA evaluation metrics and semantic evaluation metrics: Black-box and Open-Source large language model promp
Stars
- LlamaFactory
- 73k
- qa_metrics
- 61
Forks
- LlamaFactory
- 8.9k
- qa_metrics
- 6
Open issues
- LlamaFactory
- 1.1k
- qa_metrics
- 0
Language
- LlamaFactory
- Python
- qa_metrics
- Python
Adopt for
- LlamaFactory
- LlamaFactory is a sophisticated tool for fine-tuning numerous large language models and visual language models efficiently using various methods such as LoRA, QLoRA, RLHF, and quantization.
- qa_metrics
- -
Persona
- LlamaFactory
- -
- qa_metrics
- -
Runtime
- LlamaFactory
- -
- qa_metrics
- -
License
- LlamaFactory
- Apache-2.0
- qa_metrics
- MIT
Last pushed
- LlamaFactory
- Jul 10, 2026
- qa_metrics
- Jul 18, 2025
Categories
- LlamaFactory
- LLM Frameworks, Model Training
- qa_metrics
- Developer Tools, LLM Frameworks, Model Training
Trust and health
Maintenance
- LlamaFactory
- Very active (96%)
- qa_metrics
- Slowing (36%)
Days since push
- LlamaFactory
- 0d
- qa_metrics
- 361d
Open issues (now)
- LlamaFactory
- 1.1k
- qa_metrics
- 0
Full report
- LlamaFactory
- Trust report
- qa_metrics
- Trust report
Choose LlamaFactory if…
- License: LlamaFactory is Apache-2.0, qa_metrics is MIT.
- Tags unique to LlamaFactory: agent, ai, deepseek, fine-tuning.
- When you need to fine-tune over 100 different LLMs or VLMs with efficient methods like LoRA or QLoRA.
When NOT to use LlamaFactory
- When you are looking to fine-tune less popular or niche models that are not supported within the 100+ models covered by LlamaFactory.
- If your project specifically requires custom fine-tuning methods not available in this repository, such as certain versions of PEFT (Parameter Efficient Fine-Tuning) techniques excluding LoRA and QLoa
Choose qa_metrics if…
- License: qa_metrics is MIT, LlamaFactory is Apache-2.0.
- Tags unique to qa_metrics: exact-matching, llm, llm-evaluation, llm-evaluation-framework.
- Also covers Developer Tools.
When NOT to use qa_metrics
- Last GitHub push was 361 days ago (slowing maintenance, Jul 18, 2025). Validate activity before betting a new project on qa_metrics.
- Developer Tools: A gateway is overkill when you're pinned to a single provider and model.
- LLM Frameworks: Avoid a framework for a single prompt-and-retrieve call; the abstraction can cost more than it saves.
- Model Training: Try prompting and RAG first; fine-tuning is the answer to style/format, not missing knowledge.
Explore
Sources
Every stat on this page traces to a dated GitHub sync, license file, enrichment field, or trust scan.
- GitHub stars (hiyouga/LlamaFactory) · observed Jul 11, 2026
- GitHub forks (hiyouga/LlamaFactory) · observed Jul 11, 2026
- Last push (hiyouga/LlamaFactory) · observed Jul 10, 2026
- License file (Apache-2.0) · observed Jul 11, 2026
- Decision facts (enrichment) · observed Jul 11, 2026
- Trust scan (lockfile / OSV) · observed Jul 11, 2026
- GitHub stars (zli12321/qa_metrics) · observed Jul 15, 2026
- GitHub forks (zli12321/qa_metrics) · observed Jul 15, 2026
- Last push (zli12321/qa_metrics) · observed Jul 18, 2025
- License file (MIT) · observed Jul 15, 2026
- Trust scan (lockfile / OSV) · observed Jul 15, 2026
GitHub stars on cards: LlamaFactory 73k · qa_metrics 61 (synced Jul 11, 2026).
Common questions
- What is the difference between LlamaFactory and qa_metrics?
- LlamaFactory: Unified Efficient Fine-Tuning of 100+ LLMs & VLMs. qa_metrics: An easy python package to run quick basic QA evaluations. This package includes standardized QA evaluation metrics and semantic evaluation metrics: Black-box and Open-Source large language model promp. See the comparison table for live GitHub stats and shared categories.
- When should I choose LlamaFactory over qa_metrics?
- Choose LlamaFactory over qa_metrics when License: LlamaFactory is Apache-2.0, qa_metrics is MIT; Tags unique to LlamaFactory: agent, ai, deepseek, fine-tuning; When you need to fine-tune over 100 different LLMs or VLMs with efficient methods like LoRA or QLoRA.
- When should I choose qa_metrics over LlamaFactory?
- Choose qa_metrics over LlamaFactory when License: qa_metrics is MIT, LlamaFactory is Apache-2.0; Tags unique to qa_metrics: exact-matching, llm, llm-evaluation, llm-evaluation-framework; Also covers Developer Tools.
- When should I avoid LlamaFactory?
- When you are looking to fine-tune less popular or niche models that are not supported within the 100+ models covered by LlamaFactory. If your project specifically requires custom fine-tuning methods not available in this repository, such as certain versions of PEFT (Parameter Efficient Fine-Tuning) techniques excluding LoRA and QLoa
- When should I avoid qa_metrics?
- Last GitHub push was 361 days ago (slowing maintenance, Jul 18, 2025). Validate activity before betting a new project on qa_metrics. Developer Tools: A gateway is overkill when you're pinned to a single provider and model. LLM Frameworks: Avoid a framework for a single prompt-and-retrieve call; the abstraction can cost more than it saves. Model Training: Try prompting and RAG first; fine-tuning is the answer to style/format, not missing knowledge.
- Is LlamaFactory or qa_metrics more popular on GitHub?
- LlamaFactory has more GitHub stars (73,157 vs 61). Stars measure visibility, not whether either tool fits your constraints.
- Are LlamaFactory and qa_metrics open source?
- Yes - both are open-source projects on GitHub (LlamaFactory: Apache-2.0, qa_metrics: MIT).
- Where can I find alternatives to LlamaFactory or qa_metrics?
- GraphCanon lists graph-backed alternatives at LlamaFactory alternatives and qa_metrics alternatives (LlamaFactory markdown twin, qa_metrics markdown twin), ranked by typed relationship edges rather than popularity votes.
- Is there a machine-readable version of this comparison?
- Yes. The markdown twin at this comparison mirrors this page for agents and LLM crawlers, with the same stats table and FAQ answers.
- Which is better maintained, LlamaFactory or qa_metrics?
- LlamaFactory: Very active. qa_metrics: Slowing. Compare maintenance labels, days since push, and release cadence in the trust section below - stars alone do not measure maintenance.
- Where are the full trust reports for LlamaFactory and qa_metrics?
- GraphCanon publishes per-repo trust reports with dated maintenance, provenance, and scan summaries: LlamaFactory trust report; qa_metrics trust report.