Results for “vllm”

vllm-ascend

vllm-project/vllm-ascend

Community maintained hardware plugin for vLLM on Ascend

vllm

vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

OpenRLHF

OpenRLHF/OpenRLHF

An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray

litellm

BerriAI/litellm

Python SDK and Proxy Server for calling over 100 LLM APIs in OpenAI format

UltraRAG

OpenBMB/UltraRAG

Less Code, Lower Barrier, Faster Deployment

prometheus-eval

prometheus-eval/prometheus-eval

Evaluate your LLM's response with Prometheus and GPT4