research
∙
07/25/2021
SGD May Never Escape Saddle Points
Stochastic gradient descent (SGD) has been deployed to solve highly non-...
share
research
∙
05/20/2021
Logarithmic landscape and power-law escape rate of SGD
Stochastic gradient descent (SGD) undergoes complicated multiplicative n...
research
∙
02/12/2020
LaProp: a Better Way to Combine Momentum with Adaptive Gradient
Identifying a divergence problem in Adam, we propose a new optimizer, La...
research
∙
06/29/2019
