Home/Inference & Serving/vllm-cli

vllm-cli

Chen-zexi/vllm-cli

Command-line interface for serving LLM using vLLM

GitHub

GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026

27views this month

505 stars29 forksLast push Jan 25, 2026 Python MIT

Decision brief

vllm-cli serves large language models via vLLM with a straightforward CLI interface, ideal for users preferring a command-line environment over graphical tools.

Good fit when

When you require an efficient and robust way to serve large language models through the command line using vLLM framework
If your development pipeline already heavily relies on Python scripts and you prefer not to leave your terminal

Avoid when

If your project demands a graphical user interface or web-based interaction for model serving
When ease of use with non-Python environments is a priority, as vllm-cli is designed specifically for Python users

Observed Jul 17, 2026 · Source: enrich:decision_facts

vllm-cli alternatives Trust report

Verify the decision

Maintenance and security

Full trust report

Maintenance: Slowing (237d since push); As of Sep 20, 2026
Provenance: Not a fork · Personal account; As of Sep 20, 2026
Security (OSV): No lockfile; As of Jul 11, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

pip install vllm-cli

PyPI

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

llm

Access large language models from the command-line

12k★

inference

Unified production-ready inference API for various LLMs and models

9.6k★

oumi

Easily fine-tune, evaluate and deploy open source LLMs/VLMs

9.4k★

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

Chen-zexi/vllm-cli is a Python-based tool designed to serve large language models with a command-line interface through the vLLM framework.

Capability facts

CLI: CLI entrypoint
Source: pyproject.toml:[project.scripts] · Sep 20, 2026
Languages: python
Source: github.language+pyproject.toml · Sep 20, 2026

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Python runtimePython

Source: README excerpt (regex_v1, Sep 20, 2026)

uv venv --python 3.12 --seed

Source link

README

🚀 Hardware Optimized Profiles for GPT OSS Models New built in profiles specifically optimized for serving GPT OSS models on different GPU architectures: Optimized for NVIDIA A100 GPUs Optimized for NVIDIA H100/H200 GPUs Optimized for NVIDIA Blackwell GPUs Based on official vLLM...

For agents

This page has a .md twin and JSON over the API.

/tools/chen-zexi-vllm-cli.md GET /api/graphcanon/tools/chen-zexi-vllm-cli GET /api/graphcanon/graph?tool=chen-zexi-vllm-cli