research
∙
06/30/2023
The Shaped Transformer: Attention Models in the Infinite Depth-and-Width Limit
In deep learning theory, the covariance matrix of the representations se...
share
research
∙
02/16/2023
Improved Discretization Analysis for Underdamped Langevin Monte Carlo
Underdamped Langevin Monte Carlo (ULMC) is an algorithm used to sample f...
research
∙
06/06/2022
The Neural Covariance SDE: Shaped Infinite Depth-and-Width Networks at Initialization
The logit outputs of a feedforward neural network at initialization are ...
research
∙
12/23/2021
Analysis of Langevin Monte Carlo from Poincaré to Log-Sobolev
Classically, the continuous-time Langevin diffusion converges exponentia...
research
∙
06/07/2021
The Future is Log-Gaussian: ResNets and Their Infinite-Depth-and-Width Limit at Initialization
Theoretical results show that neural networks can be approximated by Gau...
research
∙
02/11/2021
Higher Order Generalization Error for First Order Discretization of Langevin Diffusion
We propose a novel approach to analyze generalization error for discreti...
research
∙
10/21/2020
