gpustack
A GPU cluster manager for high-performance AI model serving and on-demand SSH-accessible GPU instances
GraphCanon updated 2w · GitHub synced 2w
Decision brief
gpustack is a Python-based tool for managing GPU clusters focused on efficient AI model inference and on-demand SSH-accessible GPU instances.
Good fit when
- When you need to manage multiple GPUs for high-performance inference tasks with models like vLLM or SGLang.
- For environments where you prefer an easy-to-use UI for handling complex operations related to GPU cluster management.
Avoid when
- If your deployment constraints do not permit the use of Docker containers and there is a need for bare-metal deployments without containerized solutions.
- When the tool-specific focus on certain models like vLLM or SGLang does not align with the model ecosystem preferred by your team.
- Pricing:
- freemium
- Requirements:
- Requires Docker
Observed Jul 14, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Very active (0d since push)
- As of 2w
- Provenance
- Not a fork · Organization account
- As of 2w
- Security (OSV)
- No lockfile
- As of 1mo
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
pip install gpustackSimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
gpustack/gpustack is a Python-based repository that provides a GPU cluster management service tailored for efficient AI model inference, including support for managing models like vLLM and SGLang through an easily accessible UI.
Capability facts
- CLI
- CLI entrypoint
Source: pyproject.toml:[project.scripts] · Aug 7, 2026
- Languages
- python
Source: github.language+pyproject.toml · Aug 7, 2026
Categories
Tags
README
Install GPUStack
Run the following command to install and start the GPUStack server using Docker:
sudo docker run -d --name gpustack \
--restart unless-stopped \
-p 80:80 \
--volume gpustack-data:/var/lib/gpustack \
gpustack/gpustack
Alternative: Use Quay Container Registry Mirror
If you cannot pull images from Docker Hub or the download is very slow, you can use our Quay.io mirror by pointing your registry to quay.io:
sudo docker run -d --name gpustack \
--restart unless-stopped \
-p 80:80 \
--volume gpustack-data:/var/lib/gpustack \
quay.io/gpustack/gpustack \
--system-default-container-registry quay.io
Check the GPUStack startup logs:
sudo docker logs -f gpustack
After GPUStack starts, run the following command to get the default admin password:
sudo docker exec gpustack cat /var/lib/gpustack/initial_admin_password
Open your browser and navigate to http://your_host_ip to access the GPUStack UI. Use the default username admin and the password you retrieved above to log in.
License
Copyright (c) 2024-2026 The GPUStack authors
Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at LICENSE file for details.
Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.
For agents
This page has a .md twin and JSON over the API.