research
∙
08/31/2021
Using a one dimensional parabolic model of the full-batch loss to estimate learning rates during training
A fundamental challenge in Deep Learning is to find optimal step sizes f...
share
research
∙
03/31/2021
Empirically explaining SGD from a line search perspective
Optimization in Deep Learning is mainly guided by vague intuitions and s...
research
∙
10/02/2020
A straightforward line search approach on the expected empirical loss for stochastic deep learning problems
A fundamental challenge in deep learning is that the optimal step sizes ...
research
∙
03/28/2019