Search results
2 tools · ranked by relevance and freshness, not ad spend.
lmdeploy
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
openinfer
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
