
DeepSpeed Boosts Multimodal Training Efficiency
DeepSpeed releases a PyTorch-identical backward API for efficient training of multimodal and multi-component models, including non-scalar backward calls. It also introduces low-precision model optimizations to enhance memory efficiency during training.






