research
∙
06/30/2023
The Shaped Transformer: Attention Models in the Infinite Depth-and-Width Limit
In deep learning theory, the covariance matrix of the representations se...
share
research
∙
12/11/2019
Linear Mode Connectivity and the Lottery Ticket Hypothesis
We introduce "instability analysis," a framework for assessing whether t...
research
∙
12/09/2019
