research
∙
09/15/2022
Random initialisations performing above chance and how to find them
Neural networks trained with stochastic gradient descent (SGD) starting ...
share
research
∙
01/28/2022
Gradient Descent on Neurons and its Link to Approximate Second-Order Optimization
Second-order optimizers are thought to hold the potential to speed up ne...
research
∙
06/11/2020
Understanding Regularisation Methods for Continual Learning
The problem of Catastrophic Forgetting has received a lot of attention i...
research
∙
02/11/2019