qlora logo

qlora

artidoro/qlora

QLoRA finetuning of quantized LLMs

GraphCanon updated Sep 26, 2026 · GitHub synced Sep 26, 2026

45views this month

11k stars876 forksLast push Jun 10, 2024 Jupyter Notebook MIT

Decision brief

QLoRA specializes in accelerating the fine-tuning process of quantized large language models like those in the Guanaco family.

Good fit when

  • Need efficient fine-tuning for quantized LLaMA-based models
  • Working with limited computational resources, aiming to maintain performance

Avoid when

  • Require native full-precision model tuning without efficiency constraints
  • Focusing on non-LLaMA-based language models where specific adaptations may not apply
Pricing:
freemium - Open source under MIT License; requires access to LLaMA base models
Requirements:
Installation involves installing PyTorch and specific packages from source; Works with model sizes ranging from 7B to 65B, includes recommendations for tuning different sizes

Observed Jul 17, 2026 · Source: enrich:decision_facts

Verify the decision

Maintenance and security

Full trust report
Maintenance
Dormant (837d since push)
As of Sep 26, 2026
Provenance
Not a fork · Personal account
As of Sep 26, 2026
Security (OSV)
48 low (48 low)
As of Jul 11, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

git clone https://github.com/artidoro/qlora

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

A repository for QLoRA, which provides tools for efficient fine-tuning of quantized large language models including the Guanaco model family.

Capability facts

Languages
jupyter notebook

Source: github.language · Sep 26, 2026

Categories

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Python runtimePython

Source: README excerpt (regex_v1, Sep 26, 2026)

python qlora.py --model_name_or_path <path_or_name>
Source link

Tags

README

License and Intended Use We release the resources associated with QLoRA finetuning in this repository under MIT license. In addition, we release the Guanaco model family for base LLaMA model sizes of 7B, 13B, 33B, and 65B. These models are intended for purposes in line with the L...

For agents

This page has a .md twin and JSON over the API.

Was this helpful?

Anonymous feedback helps us improve pages and translations.