bitsandbytes
Enrichment pendingAccessible large language models via k-bit quantization for PyTorch.
GraphCanon updated today · GitHub synced today
Trust & integrity
Full report- Maintenance
- Very active (2d since push)
- As of today · Source: github_public_v1
- Provenance
- Not a fork · Organization account
- As of today · Source: github_public_v1
- Security (OSV)
- No lockfile
- As of today · Source: none
Public GitHub metadata and optional OSV dependency scans. Signals, not a guarantee. Trust methodology.
Overview
Accessible large language models via k-bit quantization for PyTorch.
Capability facts
- Languages
- python
Source: github.language+pyproject.toml · Jul 11, 2026
Categories
Compatibility
Sourced claims from the README excerpt - not unsourced marketing copy.
Tags
README
System Requirements
bitsandbytes has the following minimum requirements for all platforms:
- Python 3.10+
- PyTorch 2.4+
- Note: While we aim to provide wide backwards compatibility, we recommend using the latest version of PyTorch for the best experience.
Accelerator support:
Note: this table reflects the status of the current development branch. For the latest stable release, see the document in the 0.49.2 tag.
Legend:
🚧 = In Development, 〰️ = Partially Supported, ✅ = Supported, 🐢 = Slow Implementation Supported, ❌ = Not Supported
| Platform | Accelerator | Hardware Requirements | LLM.int8() | QLoRA 4-bit | 8-bit Optimizers |
|---|---|---|---|---|---|
| 🐧 Linux, glibc >= 2.24 | |||||
| x86-64 | ◻️ CPU | Minimum: AVX2 Optimized: AVX512F, AVX512BF16 | ✅ | ✅ | ✅ |
🟩 NVIDIA GPU cuda | SM60+ minimum SM75+ recommended | ✅ | ✅ | ✅ | |
🟥 AMD GPU cuda |
CDNA: gfx90a, gfx942, gfx950 RDNA: gfx1100, gfx1101, gfx1102, gfx1103, gfx1150, gfx1151, gfx1152, gfx1153, gfx1200, gfx1201 | ✅ | ✅ | ✅ | |
🟦 Intel GPU xpu |
Data Center GPU Max Series Arc A-Series (Alchemist) Arc B-Series (Battlemage) | ✅ | ✅ | ✅ | |
🟪 Intel Gaudi hpu | Gaudi2, Gaudi3 | ✅ | 〰️ | ❌ | |
| aarch64 | ◻️ CPU | ✅ | ✅ | ✅ | |
🟩 NVIDIA GPU cuda | SM75+ | ✅ | ✅ | ✅ | |
| 🪟 Windows 11 / Windows Server 2022+ | |||||
| x86-64 | ◻️ CPU | AVX2 | ✅ | ✅ | ✅ |
🟩 NVIDIA GPU cuda | SM60+ minimum SM75+ recommended | ✅ | ✅ | ✅ | |
🟥 AMD GPU cuda |
RDNA: gfx1100, gfx1101, gfx1102, gfx1150, gfx1151, gfx1200, gfx1201 | ✅ | ✅ | ✅ | |
🟦 Intel GPU xpu |
Arc A-Series (Alchemist) Arc B-Series (Battlemage) | ✅ | ✅ | ✅ | |
| arm64 | ◻️ CPU | ✅ | ✅ | ✅ | |
| 🍎 macOS 14+ | |||||
| arm64 | ◻️ CPU | Apple M1+ | ✅ | ✅ | ✅ |
⬜ Metal mps | Apple M1+ | 🐢 | 🐢 | 🚧 | |
License
bitsandbytes is MIT licensed.