tiny-vllm
Enrichment pendingBuild your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM
GraphCanon updated today · GitHub synced today
909
Stars
61
Forks
1
Open issues
3
Watchers
1w
Last push
C++ Apache-2.0Created Feb 9, 2026
Trust & integrity
Full report- Maintenance
- Active (8d since push)
- As of today · Source: github_public_v1
- Provenance
- Not a fork · Personal account
- As of today · Source: github_public_v1
- Security (OSV)
- No lockfile
- As of today · Source: none
Public GitHub metadata and optional OSV dependency scans. Signals, not a guarantee. Trust methodology.
Overview
Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM
Capability facts
- Languages
- c++
Source: github.language · Jul 11, 2026