research
∙
09/29/2022
NAG-GS: Semi-Implicit, Accelerated and Robust Stochastic Optimizers
Classical machine learning models such as deep neural networks are usual...
share
research
∙
01/31/2022
Memory-Efficient Backpropagation through Large Linear Layers
In modern neural networks like Transformers, linear layers require signi...
research
∙
10/02/2021
Fast Line Search for Multi-Task Learning
Multi-task learning is a powerful method for solving several tasks joint...
research
∙
07/14/2020
Follow the bisector: a simple method for multi-objective optimization
This study presents a novel Equiangular Direction Method (EDM) to solve ...
research
∙
04/19/2020
Stochastic gradient algorithms from ODE splitting perspective
We present a different view on stochastic optimization, which goes back ...
research
∙
06/14/2019