research
∙
01/31/2023
The Power of External Memory in Increasing Predictive Model Capacity
One way of introducing sparsity into deep networks is by attaching an ex...
share
research
∙
01/30/2023
Alternating Updates for Efficient Transformers
It is well established that increasing scale in deep transformer network...
research
∙
08/08/2022
A Theoretical View on Sparsely Activated Networks
Deep and wide neural networks successfully fit very complex functions to...
research
∙
04/13/2022
A Unified Cascaded Encoder ASR Model for Dynamic Model Sizes
In this paper, we propose a dynamic cascaded encoder Automatic Speech Re...
research
∙
12/21/2021
Provable Hierarchical Lifelong Learning with a Sketch-based Modular Architecture
We propose a modular architecture for the lifelong learning of hierarchi...
research
∙
03/29/2021
One Network Fits All? Modular versus Monolithic Task Formulations in Neural Networks
Can deep learning solve multiple tasks simultaneously, even when they ar...
research
∙
03/11/2021
For Manifold Learning, Deep Neural Networks can be Locality Sensitive Hash Functions
It is well established that training deep neural networks gives useful r...
research
∙
05/15/2020
Learning the gravitational force law and other analytic functions
Large neural network models have been successful in learning functions o...
research
∙
10/03/2019
How does the Mind store Information?
How we store information in our mind has been a major intriguing open qu...
research
∙
05/29/2019
Recursive Sketches for Modular Deep Learning
We present a mechanism to compute a sketch (succinct summary) of how a c...
research
∙
04/08/2019
On the Learnability of Deep Random Networks
In this paper we study the learnability of deep random networks from bot...
research
∙
03/21/2019
Learning Two layer Networks with Multinomial Activation and High Thresholds
Giving provable guarantees for learning neural networks is a core challe...
research
∙
11/13/2013
Sparse Matrix Factorization
We investigate the problem of factorizing a matrix into several sparse m...
research
∙
04/29/2013
Optimal amortized regret in every interval
Consider the classical problem of predicting the next bit in a sequence ...
research
∙
03/01/2012
