research
∙
12/01/2022
Simplifying and Understanding State Space Models with Diagonal Linear RNNs
Sequence models based on linear state spaces (SSMs) have recently emerge...
share
research
∙
11/24/2022
Differentially Private Image Classification from Features
Leveraging transfer learning has recently been shown to be an effective ...
research
∙
11/20/2022
Convexifying Transformers: Improving optimization and understanding of transformer networks
Understanding the fundamental mechanism behind the success of transforme...
research
∙
06/27/2022
Long Range Language Modeling via Gated State Spaces
State space models have shown to be effective at modeling long range dep...
research
∙
05/06/2022
Large Scale Transfer Learning for Differentially Private Image Classification
Differential Privacy (DP) provides a formal framework for training machi...
research
∙
12/03/2021
ALX: Large Scale Matrix Factorization on TPUs
We present ALX, an open-source library for distributed matrix factorizat...
research
∙
06/28/2021
High-probability Bounds for Non-Convex Stochastic Optimization with Heavy Tails
We consider non-convex stochastic optimization using first-order algorit...
research
∙
08/31/2020
Extreme Memorization via Scale of Initialization
We construct an experimental setup in which changing the scale of initia...
research
∙
02/09/2020
Momentum Improves Normalized SGD
We provide an improved analysis of normalized SGD showing that adding mo...
research
∙
01/10/2020
Retouchdown: Adding Touchdown to StreetLearn as a Shareable Resource for Language Grounding Tasks in Street View
The Touchdown dataset (Chen et al., 2019) provides instructions by human...
research
∙
12/06/2019
VALAN: Vision and Language Agent Navigation
VALAN is a lightweight and scalable software framework for deep reinforc...
research
∙
08/09/2019
Transferable Representation Learning in Vision-and-Language Navigation
Vision-and-Language Navigation (VLN) tasks such as Room-to-Room (R2R) re...
research
∙
05/31/2019