research
∙
09/07/2023
Pareto Frontiers in Neural Feature Learning: Data, Compute, Width, and Luck
This work investigates the nuanced algorithm design choices for deep lea...
share
research
∙
07/18/2022
Hidden Progress in Deep Learning: SGD Learns Parities Near the Computational Limit
There is mounting empirical evidence of emergent phenomena in the capabi...
research
∙
10/19/2021
Inductive Biases and Variable Creation in Self-Attention Mechanisms
Self-attention, an architectural motif designed to model long-range inte...
research
∙
02/12/2020
The Multiplayer Colonel Blotto Game
We initiate the study of the natural multiplayer generalization of the c...
research
∙
05/28/2019