“training acceleration”

Awesome-LLM-Compression

Awesome LLM compression research papers and tools to accelerate LLM training and inference.

accelerate

🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support

CodeGen

Family of open-source models for program synthesis.

TransformerEngine

A library accelerating Transformer models on NVIDIA GPUs using low precision formats.