gpustack
A GPU cluster manager for high-performance AI model serving and on-demand SSH-accessible GPU instances
GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026
44views this month
Decision brief
gpustack is a GPU cluster manager that supports high-performance AI model serving and on-demand SSH-accessible GPU instances, suitable for environments requiring robust management of GPU resources and support for various
Good fit when
- When you need to manage a GPU cluster for high-performance AI model serving and require on-demand SSH-accessible GPU instances.
- If your project involves the use of specific AI frameworks and technologies such as vLLM and SGLang, which are supported by gpustack.
Avoid when
- If your project does not require the specific AI frameworks and technologies supported by gpustack, such as vLLM and SGLang, and you need broader support.
- When you are looking for a solution that does not rely on Docker for deployment, as gpustack requires Docker for installation and management.
- Pricing:
- freemium - gpustack is free to use under the Apache License, Version 2.0, but users may incur costs related to the infrastructure and resources used to run the tool.
- Requirements:
- Min 4 GB RAM; Requires Docker; gpustack requires Docker for installation and management.; Ensure that the Docker environment is properly set up and that the user has the necessary permissions to run Docker commands.
Observed Sep 18, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Very active (1d since push)
- As of Sep 18, 2026
- Provenance
- Not a fork · Organization account
- As of Sep 18, 2026
- Security (OSV)
- No lockfile
- As of Sep 18, 2026
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
pip install gpustackSimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
gpustack/gpustack is a tool for managing GPU clusters, facilitating high-performance AI model serving and providing on-demand SSH-accessible GPU instances. It supports various AI frameworks and technologies, including vLLM, SGLang, and more.
Capability facts
- CLI
- CLI entrypoint
Source: pyproject.toml:[project.scripts] · Sep 18, 2026
- Languages
- python
Source: github.language+pyproject.toml · Sep 18, 2026
Categories
Tags
README
Install GPUStack Run the following command to install and start the GPUStack server using Docker: <details <summary Alternative: Use Quay Container Registry Mirror</summary If you cannot pull images from or the download is very slow, you can use our mirror by pointing your regist...
For agents
This page has a .md twin and JSON over the API.