research
∙
04/17/2023
Bridging Discrete and Backpropagation: Straight-Through and Beyond
Backpropagation, the cornerstone of deep learning, is limited to computi...
share
research
∙
02/20/2023
Deep Vision in Analysis and Recognition of Radar Data: Achievements, Advancements and Challenges
Radars are widely used to obtain echo information for effective predicti...
research
∙
12/15/2022
Efficient Long Sequence Modeling via State Space Augmented Transformer
Transformer models have achieved superior performance in various natural...
research
∙
05/20/2022
Visually-Augmented Language Modeling
Human language is grounded on multimodal knowledge including visual know...
research
∙
06/05/2020
DeBERTa: Decoding-enhanced BERT with Disentangled Attention
Recent progress in pre-trained neural language models has significantly ...
research
∙
04/17/2020
Understanding the Difficulty of Training Transformers
Transformers have been proved effective for many deep learning tasks. Tr...
research
∙
02/28/2020
UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training
We propose to pre-train a unified language model for both autoencoding a...
research
∙
05/08/2019
Unified Language Model Pre-training for Natural Language Understanding and Generation
This paper presents a new Unified pre-trained Language Model (UniLM) tha...
research
∙
03/25/2019
Cyclical Annealing Schedule: A Simple Approach to Mitigating KL Vanishing
Variational autoencoders (VAEs) with an auto-regressive decoder have bee...
research
∙
11/14/2017
