research
∙
05/22/2023
SignSVRG: fixing SignSGD via variance reduction
We consider the problem of unconstrained minimization of finite sums of ...
share
research
∙
03/16/2023
Orthogonal Directions Constrained Gradient Method: from non-linear equality constraints to Stiefel manifold
We consider the problem of minimizing a non-convex function over a smoot...
research
∙
11/07/2022
AskewSGD : An Annealed interval-constrained Optimisation method to train Quantized Neural Networks
In this paper, we develop a new algorithm, Annealed Skewed SGD - AskewSG...
research
∙
09/06/2021
Stochastic Subgradient Descent on a Generic Definable Function Converges to a Minimizer
It was previously shown by Davis and Drusvyatskiy that every Clarke crit...
research
∙
08/04/2021
Stochastic Subgradient Descent Escapes Active Strict Saddles
In non-smooth stochastic optimization, we establish the non-convergence ...
research
∙
05/18/2020