research
∙
09/14/2023
Advancing Regular Language Reasoning in Linear Recurrent Neural Networks
In recent studies, linear recurrent neural networks (LRNNs) have achieve...
share
research
∙
05/05/2023
Transformer Working Memory Enables Regular Language Reasoning and Natural Language Length Extrapolation
Unlike recurrent models, conventional wisdom has it that Transformers ca...
research
∙
12/20/2022
Receptive Field Alignment Enables Transformer Length Extrapolation
Length extrapolation is a desirable property that permits training a tra...
research
∙
06/15/2022
Training Discrete Deep Generative Models via Gapped Straight-Through Estimator
While deep generative models have succeeded in image processing, natural...
research
∙
05/20/2022
KERPLE: Kernelized Relative Positional Embedding for Length Extrapolation
Relative positional embeddings (RPE) have received considerable attentio...
research
∙
10/06/2021
Explaining Off-Policy Actor-Critic From A Bias-Variance Perspective
Off-policy Actor-Critic algorithms have demonstrated phenomenal experime...
research
∙
09/17/2021
Soft Actor-Critic With Integer Actions
Reinforcement learning is well-studied under discrete actions. Integer a...
research
∙
09/08/2021
PowerGym: A Reinforcement Learning Environment for Volt-Var Control in Power Distribution Systems
We introduce PowerGym, an open-source reinforcement learning environment...
research
∙
09/18/2020
A Contraction Approach to Model-based Reinforcement Learning
Model-based Reinforcement Learning has shown considerable experimental s...
research
∙
09/25/2019