Home/Inference & Serving/vllm-ascend

vllm-ascend

vllm-project/vllm-ascend

Community maintained hardware plugin for vLLM on Ascend

GitHub Website

GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026

38views this month

2.9k stars2.3k forksLast push Sep 20, 2026 C++ Apache-2.0

Decision brief

vllm-ascend: Ascend hardware plugin for vLLM in C++

Good fit when

You need to optimize large language model inference on Ascend hardware
Your project prioritizes community-driven enhancements and support

Avoid when

If you require support for GPU or CPU only setups without Ascend hardware
When seeking proprietary software, as vllm-ascend is open-source under Apache License 2.0

Observed Jul 12, 2026 · Source: enrich:decision_facts

vllm-ascend alternatives Trust report

Verify the decision

Maintenance and security

Full trust report

Maintenance: Very active (0d since push); As of Sep 20, 2026
Provenance: Not a fork · Organization account; As of Sep 20, 2026
Security (OSV): 9 low (9 low); As of Jul 11, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Backing

Company context for vLLM. Display-only - separate from trust and ranking.

Company: vLLM·GitHub org profile·Jul 11, 2026
Commercial model: Pure OSS·GitHub org profile (public repos)·Jul 11, 2026

Install

git clone https://github.com/vllm-project/vllm-ascend

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

92k★

omlx

LLM inference server with continuous batching and SSD caching for Apple Silicon

22k★

TensorRT-LLM

Python API for defining and optimizing Large Language Models for efficient inference on NVIDIA GPUs

15k★

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

vllm-project/vllm-ascend is a community-driven project to enhance vLLM's compatibility with Ascend hardware. It aims at optimizing the deployment and inference capabilities of large language models using C++.

Capability facts

Deploy: Self-host
Source: dockerfile:Dockerfile · Sep 20, 2026
Docker: Dockerfile present
Source: dockerfile:Dockerfile · Sep 20, 2026
Languages: c++, python
Source: github.language+pyproject.toml · Sep 20, 2026

Graph entities

vLLMcompany

README

Getting Started Please use the following recommended versions to get started quickly: Version Release type Doc v0.26.0rc1 Release candidate See QuickStart and Installation for more details v0.23.0 Latest stable version See QuickStart and Installation for more details License Apac...

For agents

This page has a .md twin and JSON over the API.

/tools/vllm-project-vllm-ascend.md GET /api/graphcanon/tools/vllm-project-vllm-ascend GET /api/graphcanon/graph?tool=vllm-project-vllm-ascend