research
∙
03/31/2023
Analysis and Comparison of Two-Level KFAC Methods for Training Deep Neural Networks
As a second-order method, the Natural Gradient Descent (NGD) has the abi...
share
research
∙
08/03/2022
S-estimation in Linear Models with Structured Covariance Matrices
We provide a unified approach to S-estimation in balanced linear models ...
research
∙
01/25/2022
Efficient Approximations of the Fisher Matrix in Neural Networks using Kronecker Product Singular Value Decomposition
Several studies have shown the ability of natural gradient descent to mi...
research
∙
07/06/2020