Results for “llm”
5 tools · C++
All languagesCC#C++ClojureCSSCudaGoHTMLJavaJavaScriptJupyter NotebookMakefileMDXPHPPythonRubyRustShellTypeScript
zvec
alibaba/zvec
A lightweight, lightning-fast, in-process vector database
14k 847C++
PowerInfer
Tiiny-AI/PowerInfer
High-speed Large Language Model Serving for Local Deployment
9.6k 585C++
deeplake
activeloopai/deeplake
Deeplake: AI Data Runtime for Agents
9.2k 721C++
infinity
infiniflow/infinity
AI-native database for LLM applications
4.6k 430C++
vllm-ascend
vllm-project/vllm-ascend
Community maintained hardware plugin for vLLM on Ascend
2.4k 1.6kC++