Results for “cuda”

vllm

vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

sglang

sgl-project/sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

DeepLearningExamples

NVIDIA/DeepLearningExamples

State-of-the-Art Deep Learning scripts organized by models for easy training and deployment with reproducible accuracy on NVIDIA GPUs.

rtp-llm

alibaba/rtp-llm

RTP-LLM: Alibaba's high-performance LLM inference engine