Home/Search

Search results

“inference & serving”

2 tools · ranked by relevance and freshness, not ad spend.

FilterAll C C#C++Clojure CSS Cuda Go HTML Java JavaScript Jupyter Notebook Makefile MDX PHP Python Ruby Rust Shell TypeScriptSort · Relevance

Community maintained hardware plugin for vLLM on Ascend

C++ascendinference

High-speed Large Language Model Serving for Local Deployment

C++large-language-modelsllama