“pipeline-parallelism”

ColossalAI

Making large AI models cheaper, faster and more accessible

DeepSpeed

Deep learning optimization library for efficient distributed training and inference

petals

Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

MPP-LLaVA

Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conversations}. Don't let the poverty limit your imagination! Train