research
∙
12/22/2021
The Importance of the Current Input in Sequence Modeling
The last advances in sequence modeling are mainly based on deep learning...
research
∙
06/17/2021
Backward Gradient Normalization in Deep Neural Networks
We introduce a new technique for gradient normalization during neural ne...
research
∙
06/18/2020
Stability of Internal States in Recurrent Neural Networks Trained on Regular Languages
We provide an empirical study of the stability of recurrent neural netwo...
research
∙
05/17/2020
Separation of Memory and Processing in Dual Recurrent Neural Networks
We explore a neural network architecture that stacks a recurrent layer a...
research
∙
08/01/2019