Home/Inference & Serving/OneCompression
OneCompression logo

OneCompression

FujitsuResearch/OneCompression

Python package for LLM compression

GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026

25views this month

426 stars20 forksLast push Sep 14, 2026 Python MIT

Decision brief

OneCompression is a Python package for compressing large language models using techniques such as quantization, with support for CUDA and MPS for different environments.

Good fit when

  • Use OneCompression when you need to compress large language models and have access to a Linux system with an NVIDIA GPU, as it supports CUDA for quantization and vLLM serving.
  • Consider OneCompression for macOS users who require MPS for inference, as it supports GPTQ quantization and Hugging Face `generate()` inference on MPS.

Avoid when

  • Avoid OneCompression if you are working on a macOS system and require vLLM serving, as it is only supported on Linux with an NVIDIA GPU.
  • Do not use OneCompression if you are working with Python 3.13 and CUDA, as the first run with `--extra vllm` may take a long time due to the lack of pre-built `xformers` wheels for this combination.

Observed Sep 18, 2026 · Source: enrich:decision_facts

Verify the decision

Maintenance and security

Full trust report
Maintenance
Very active (3d since push)
As of Sep 18, 2026
Provenance
Not a fork · Organization account
As of Sep 18, 2026
Security (OSV)
No lockfile
As of Sep 18, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

pip install OneCompression
PyPI

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

OneCompression is a Python package designed for compressing large language models using techniques such as quantization.

Capability facts

CLI
CLI entrypoint

Source: pyproject.toml:[project.scripts] · Sep 18, 2026

Languages
python

Source: github.language+pyproject.toml · Sep 18, 2026

Categories

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Python runtimePython

Source: README excerpt (regex_v1, Sep 18, 2026)

The `uv sync` command creates a Python virtual environment and installs all dependent libraries.
Source link

Tags

README

install uv (for macOS or Linux) curl LsSf https://astral.sh/uv/install.sh sh git clone https://github.com/FujitsuResearch/OneCompression.git cd OneCompression bash uv sync extra cu128 extra dev extra visualize bash uv sync extra mps extra dev extra visualize bash uv sync extra cu...

For agents

This page has a .md twin and JSON over the API.

Was this helpful?

Anonymous feedback helps us improve pages and translations.