{"data":{"slug":"vllm-project-vllm","name":"vllm","tagline":"A high-throughput and memory-efficient inference and serving engine for LLMs","github_url":"https://github.com/vllm-project/vllm","owner":"vllm-project","repo":"vllm","owner_avatar_url":"https://avatars.githubusercontent.com/u/136984999?v=4","primary_language":"Python","stars":92075,"forks":22363,"topics":["amd","blackwell","cuda","deepseek","deepseek-v3","gpt","gpt-oss","inference","kimi","llama","llm","llm-serving","model-serving","moe","openai","pytorch","qwen","qwen3","tpu","transformer"],"archived":false,"github_pushed_at":"2026-09-18T07:28:54+00:00","maintenance_label":"Very active","stars_delta_30d":4228,"url":"https://www.graphcanon.com/tools/vllm-project-vllm","markdown_url":"https://www.graphcanon.com/tools/vllm-project-vllm.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/vllm-project-vllm","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=vllm-project-vllm","description":"A high-throughput and memory-efficient inference and serving engine for LLMs","homepage_url":"https://vllm.ai","license":"Apache-2.0","open_issues":8080,"watchers":601,"ai_summary":"vLLM is a Python-based engine designed for efficient inference and serving of large language models, supporting a wide range of models and hardware configurations.","readme_excerpt":"## Getting Started\n\nInstall vLLM with [`uv`](https://docs.astral.sh/uv/) (recommended) or `pip`:\n\n```bash\nuv pip install vllm\n```\n\nOr [build from source](https://docs.vllm.ai/en/latest/getting_started/installation/gpu/index.html#build-wheel-from-source) for development.\n\nVisit our [documentation](https://docs.vllm.ai/en/latest/) to learn more.\n\n- [Installation](https://docs.vllm.ai/en/latest/getting_started/installation.html)\n- [Quickstart](https://docs.vllm.ai/en/latest/getting_started/quickstart.html)\n- [List of Supported Models](https://docs.vllm.ai/en/latest/models/supported_models.html)","github_created_at":"2023-02-09T11:23:20+00:00","created_at":"2026-07-07T15:09:03.849693+00:00","updated_at":"2026-09-20T04:28:41.784758+00:00","categories":[{"slug":"inference-serving","name":"Inference & Serving","url":"https://www.graphcanon.com/categories/inference-serving","markdown_url":"https://www.graphcanon.com/categories/inference-serving.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/inference-serving"}],"tags":[{"slug":"amd","name":"amd"},{"slug":"blackwell","name":"blackwell"},{"slug":"cuda","name":"cuda"},{"slug":"deepseek","name":"deepseek"},{"slug":"deepseek-v3","name":"deepseek-v3"},{"slug":"gpt","name":"gpt"},{"slug":"gpt-oss","name":"gpt-oss"},{"slug":"inference","name":"inference"}],"trust":{"provenance":{"is_fork":false,"github_id":599547518,"owner_type":"Organization","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-09-18T08:09:11.615Z","maintenance":{"label":"Very active","score":96,"methodology":"github_public_v1","releases_90d":8,"days_since_push":0,"last_release_at":"2026-09-09T08:54:49Z","stars_delta_30d":4228,"open_issues_delta_30d":1872},"security_summary":{"status":"no_lockfile","scanner":null,"low_count":0,"high_count":0,"last_scan_at":"2026-09-18T08:09:14.184Z","medium_count":0,"scan_profile":"none","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-09-18T08:09:10.355Z"},"has_cli":{"value":true,"source":"pyproject.toml:[project.scripts]","observed_at":"2026-09-18T08:09:10.355Z"},"languages":{"value":["python"],"source":"github.language+pyproject.toml","observed_at":"2026-09-18T08:09:10.355Z"},"license_spdx":{"value":"Apache-2.0","source":"github.license","observed_at":"2026-09-18T08:09:10.355Z"}},"decision_facts":{"hosting":null,"pricing":null,"requirements":{"notes":["Installation can be done via `uv pip install vllm` or building from source for development purposes."],"min_ram_gb":8,"requires_docker":false},"constraints":{"min_ram_gb":8,"requires_docker":false},"when_to_use":["When you need a high-throughput and memory-efficient inference engine for large language models, especially if you are working with a variety of hardware configurations including AMD, CUDA, and TPU.","If your project requires support for a wide range of models such as GPT, LLaMA, and Qwen, and you are looking for an engine that can handle these models efficiently."],"when_not_to_use":["If your project strictly requires a specific competitor's ecosystem or features that are not covered by vLLM, such as specialized model serving capabilities not supported by vLLM.","When the project's hardware setup is incompatible with the supported hardware configurations of vLLM, such as certain non-supported GPU models or configurations."],"source":"enrich:decision_facts","observed_at":"2026-09-18T12:09:24.136Z"},"constraint_facets":{"min_ram_gb":8,"requires_docker":false},"decision_summary":[{"label":"Requirements","value":"Min 8 GB RAM; Installation can be done via `uv pip install vllm` or building from source for development purposes."},{"label":"Adopt for","value":"vLLM is a Python-based engine for efficient inference and serving of large language models, offering high throughput and memory efficiency."},{"label":"License detail","value":"vLLM is licensed under the Apache-2.0 license, allowing for broad use in both open-source and commercial projects."}]}}