Search results
2 tools · ranked by relevance and freshness, not ad spend.
FasterTransformer
Transformer related optimization, including BERT, GPT
lmdeploy
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
