GraphCanon updated 2w · GitHub synced 2w
Decision brief
LMDeploy is focused on compressing and efficiently serving LLMs, making it suitable for teams already invested in CUDA environments like Nvidia's GeForce RTX 50 series.
Good fit when
- When your team operates within a CUDA environment, such as using an Nvidia GeForce RTX 50 series GPU, because the default prebuilt wheels are optimized for CUDA 12.8.
- If you aim to streamline deployment and serving processes for large language models with out-of-the-box support for frameworks like FasterTransformer.
Avoid when
- When your infrastructure relies on software environments or GPUs not aligned with CUDA 12.8, as LMDeploy's default prebuilt wheels might require adjustments to operate optimally.
- If you are working exclusively in non-Nvidia GPU ecosystems where LMDeploy's CUDA focus does not align with the hardware optimizations available.
- Requirements:
- Installation is optimized through pip in a Conda environment using Python versions between 3.10 and 3.13.
Observed Jul 14, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Very active (1d since push)
- As of 2w
- Provenance
- Not a fork · Organization account
- As of 2w
- Security (OSV)
- No lockfile
- As of 1mo
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
pip install lmdeploySimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
LMDeploy is designed to facilitate the process of compressing deep learning models, particularly large language models (LLMs), as well as their seamless deployment and serving through optimized frameworks.
Capability facts
- Languages
- python
Source: github.language+pyproject.toml · Aug 7, 2026
Categories
Compatibility
Sourced claims from the README excerpt - not unsourced marketing copy.
Source: README excerpt (regex_v1, Aug 7, 2026)
It is recommended installing lmdeploy using pip in a conda environment (python 3.10 - 3.13):Source link
Tags
README
Installation
It is recommended installing lmdeploy using pip in a conda environment (python 3.10 - 3.13):
conda create -n lmdeploy python=3.12 -y
conda activate lmdeploy
pip install lmdeploy
Starting from v0.13.0, the default prebuilt wheels published on PyPI are built against CUDA 12.8, so pip install lmdeploy is sufficient for typical setups including GeForce RTX 50 series.
License
This project is released under the Apache 2.0 license.
For agents
This page has a .md twin and JSON over the API.