research
∙
02/13/2023
SWIFT: Expedited Failure Recovery for Large-scale DNN Training
As the size of deep learning models gets larger and larger, training tak...
share
research
∙
05/05/2022
dPRO: A Generic Profiling and Optimization System for Expediting Distributed DNN Training
Distributed training using multiple devices (e.g., GPUs) has been widely...
research
∙
05/17/2021
Compressed Communication for Distributed Training: Adaptive Methods and System
Communication overhead severely hinders the scalability of distributed m...
research
∙
06/15/2015