vLLM

Open-source LLM inference project org.

GraphCanon updated 1d

Linked tools

88k

Leader stars

vllm

Top tool

Company

Entity type

Backing

Company and funding context for vLLM. Display-only - not part of trust score or organic ranking.

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

semantic-router

System level intelligent runtime for Mixture-of-Models across edge, data center and cloud

vllm-ascend

Community maintained hardware plugin for vLLM on Ascend