research
∙
07/02/2020
Adaptive Braking for Mitigating Gradient Delay
Neural network training is commonly accelerated by using multiple synchr...
share
research
∙
03/25/2020
Pipelined Backpropagation at Scale: Training Large Models without Batches
Parallelism is crucial for accelerating the training of deep neural netw...
research
∙
05/15/2019
Online Normalization for Training Neural Networks
Online Normalization is a new technique for normalizing the hidden activ...
research
∙
11/06/2017