composer

Composer is an open-source deep learning training library built on PyTorch. ^[1] It helps users run distributed training on large-scale clusters by handling low-level details such as parallelism, data loading, and memory optimization. ^[2] It is intended for training neural networks such as large language models, diffusion models, BERT-style models, transformers, and convolutional neural networks. ^[3]