research
∙
02/20/2020
Second Order Optimization Made Practical
Optimization in machine learning, both theoretical and applied, is prese...
share
research
∙
02/05/2020
Proximity Preserving Binary Code using Signed Graph-Cut
We introduce a binary embedding framework, called Proximity Preserving C...
research
∙
06/08/2019
Convolutional Bipartite Attractor Networks
In human perception and cognition, the fundamental operation that brains...
research
∙
02/13/2019
Identity Crisis: Memorization and Generalization under Extreme Overparameterization
We study the interplay between memorization and generalization of overpa...
research
∙
02/06/2019
Are All Layers Created Equal?
Understanding learning and generalization of deep architectures has been...
research
∙
02/05/2019
Exponentiated Gradient Meets Gradient Descent
The (stochastic) gradient descent and the multiplicative update method a...
research
∙
01/30/2019
Memory-Efficient Adaptive Optimization for Large-Scale Learning
Adaptive gradient-based optimizers such as AdaGrad and Adam are among th...
research
∙
06/08/2018
The Well Tempered Lasso
We study the complexity of the entire regularization path for least squa...
research
∙
02/26/2018
Shampoo: Preconditioned Stochastic Tensor Optimization
Preconditioned gradient methods are among the most general and powerful ...
research
∙
06/20/2017
A Unified Approach to Adaptive Regularization in Online and Stochastic Optimization
We describe a framework for deriving and analyzing online optimization a...
research
∙
02/18/2016
Toward Deeper Understanding of Neural Networks: The Power of Initialization and a Dual View on Expressivity
We develop a general duality between neural networks and compositional k...
research
∙
09/03/2015
Train faster, generalize better: Stability of stochastic gradient descent
We show that parametric models trained by a stochastic gradient method (...
research
∙
12/19/2013
Using Web Co-occurrence Statistics for Improving Image Categorization
Object recognition and localization are important tasks in computer visi...
research
∙
02/06/2013
Update Rules for Parameter Estimation in Bayesian Networks
This paper re-examines the problem of parameter estimation in Bayesian n...
research
∙
01/30/2013
Switching Portfolios
A constant rebalanced portfolio is an asset allocation algorithm which k...
research
∙
01/15/2013