{"data":{"slug":"gpustack-gpustack","name":"gpustack","tagline":"A GPU cluster manager for high-performance AI model serving and on-demand SSH-accessible GPU instances","github_url":"https://github.com/gpustack/gpustack","owner":"gpustack","repo":"gpustack","owner_avatar_url":"https://avatars.githubusercontent.com/u/169020824?v=4","primary_language":"Python","stars":5454,"forks":609,"topics":["ascend","cuda","deepseek","distributed-inference","genai","high-performance-inference","inference","llama","llm","llm-inference","llm-serving","maas","mindie","openai","qwen","rocm","sglang","vllm"],"archived":false,"github_pushed_at":"2026-08-07T03:09:44+00:00","maintenance_label":"Very active","url":"https://www.graphcanon.com/tools/gpustack-gpustack","markdown_url":"https://www.graphcanon.com/tools/gpustack-gpustack.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/gpustack-gpustack","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=gpustack-gpustack","description":"A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.","homepage_url":"https://gpustack.ai","license":"Apache-2.0","open_issues":673,"watchers":43,"ai_summary":"gpustack/gpustack is a Python-based repository that provides a GPU cluster management service tailored for efficient AI model inference, including support for managing models like vLLM and SGLang through an easily accessible UI.","readme_excerpt":"### Install GPUStack\n\nRun the following command to install and start the GPUStack server using Docker:\n\n```bash\nsudo docker run -d --name gpustack \\\n    --restart unless-stopped \\\n    -p 80:80 \\\n    --volume gpustack-data:/var/lib/gpustack \\\n    gpustack/gpustack\n```\n\n<details>\n<summary>Alternative: Use Quay Container Registry Mirror</summary>\n\nIf you cannot pull images from `Docker Hub` or the download is very slow, you can use our `Quay.io` mirror by pointing your registry to `quay.io`:\n\n```bash\nsudo docker run -d --name gpustack \\\n    --restart unless-stopped \\\n    -p 80:80 \\\n    --volume gpustack-data:/var/lib/gpustack \\\n    quay.io/gpustack/gpustack \\\n    --system-default-container-registry quay.io\n```\n</details>\n\nCheck the GPUStack startup logs:\n\n```bash\nsudo docker logs -f gpustack\n```\n\nAfter GPUStack starts, run the following command to get the default admin password:\n\n```bash\nsudo docker exec gpustack cat /var/lib/gpustack/initial_admin_password\n```\n\nOpen your browser and navigate to `http://your_host_ip` to access the GPUStack UI. Use the default username `admin` and the password you retrieved above to log in.\n\n---\n\n## License\n\nCopyright (c) 2024-2026 The GPUStack authors\n\nLicensed under the Apache License, Version 2.0 (the \"License\");\nyou may not use this file except in compliance with the License.\nYou may obtain a copy of the License at [LICENSE](./LICENSE) file for details.\n\nUnless required by applicable law or agreed to in writing, software\ndistributed under the License is distributed on an \"AS IS\" BASIS,\nWITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\nSee the License for the specific language governing permissions and\nlimitations under the License.","github_created_at":"2024-05-11T03:41:58+00:00","created_at":"2026-07-11T10:40:03.824313+00:00","updated_at":"2026-08-07T18:01:53.571473+00:00","categories":[{"slug":"inference-serving","name":"Inference & Serving","url":"https://www.graphcanon.com/categories/inference-serving","markdown_url":"https://www.graphcanon.com/categories/inference-serving.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/inference-serving"}],"tags":[{"slug":"ascend","name":"ascend"},{"slug":"cuda","name":"cuda"},{"slug":"deepseek","name":"deepseek"},{"slug":"distributed-inference","name":"distributed-inference"},{"slug":"genai","name":"genai"},{"slug":"high-performance-inference","name":"high-performance-inference"},{"slug":"inference","name":"inference"},{"slug":"llm","name":"llm"}],"trust":{"provenance":{"is_fork":false,"github_id":799049436,"owner_type":"Organization","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-08-07T18:01:52.797Z","maintenance":{"label":"Very active","score":96,"methodology":"github_public_v1","releases_90d":11,"days_since_push":0,"last_release_at":"2026-07-31T11:55:15Z"},"security_summary":{"status":"no_lockfile","scanner":null,"low_count":0,"high_count":0,"last_scan_at":"2026-07-11T10:40:07.590Z","medium_count":0,"scan_profile":"none","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-08-07T18:01:53.247Z"},"has_cli":{"value":true,"source":"pyproject.toml:[project.scripts]","observed_at":"2026-08-07T18:01:53.247Z"},"languages":{"value":["python"],"source":"github.language+pyproject.toml","observed_at":"2026-08-07T18:01:53.247Z"},"license_spdx":{"value":"Apache-2.0","source":"github.license","observed_at":"2026-08-07T18:01:53.247Z"}},"decision_facts":{"hosting":null,"pricing":{"model":"freemium"},"requirements":{"min_ram_gb":null,"requires_docker":true},"constraints":{"min_ram_gb":null,"pricing_model":"freemium","requires_docker":true},"when_to_use":["When you need to manage multiple GPUs for high-performance inference tasks with models like vLLM or SGLang.","For environments where you prefer an easy-to-use UI for handling complex operations related to GPU cluster management.","In scenarios where on-demand SSH-accessible GPU instances are required, allowing for direct hands-on access to compute resources."],"when_not_to_use":["If your deployment constraints do not permit the use of Docker containers and there is a need for bare-metal deployments without containerized solutions.","When the tool-specific focus on certain models like vLLM or SGLang does not align with the model ecosystem preferred by your team."],"source":"enrich:decision_facts","observed_at":"2026-07-14T21:48:20.815Z"},"constraint_facets":{"min_ram_gb":null,"pricing_model":"freemium","requires_docker":true},"decision_summary":[{"label":"Pricing","value":"freemium"},{"label":"Requirements","value":"Requires Docker"},{"label":"Adopt for","value":"gpustack is a Python-based tool for managing GPU clusters focused on efficient AI model inference and on-demand SSH-accessible GPU instances."},{"label":"License detail","value":"Apache-2.0"}]}}