research
∙
06/02/2023
Enhancing the Protein Tertiary Structure Prediction by Multiple Sequence Alignment Generation
The field of protein folding research has been greatly advanced by deep ...
share
research
∙
05/28/2023
Design, Actuation, and Functionalization of Untethered Soft Magnetic Robots with Life-Like Motions: A Review
Soft robots have demonstrated superior flexibility and functionality tha...
research
∙
05/15/2023
AF2-Mutation: Adversarial Sequence Mutations against AlphaFold2 on Protein Tertiary Structure Prediction
Deep learning-based approaches, such as AlphaFold2 (AF2), have significa...
research
∙
07/04/2022
E2Efold-3D: End-to-End Deep Learning Method for accurate de novo RNA 3D Structure Prediction
RNA structure determination and prediction can promote RNA-targeted drug...
research
∙
12/06/2021
Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention
Most of today's AI systems focus on using self-attention mechanisms and ...
research
∙
10/16/2021
Leveraging Knowledge in Multilingual Commonsense Reasoning
Commonsense reasoning (CSR) requires the model to be equipped with gener...
research
∙
05/14/2021
Joint Retrieval and Generation Training for Grounded Text Generation
Recent advances in large-scale pre-training such as GPT-3 allow seemingl...
research
∙
03/16/2021
LightningDOT: Pre-training Visual-Semantic Embeddings for Real-Time Image-Text Retrieval
Multimodal pre-training has propelled great advancement in vision-and-la...
research
∙
10/07/2020
Cross-Thought for Sentence Encoder Pre-training
In this paper, we propose Cross-Thought, a novel approach to pre-trainin...
research
∙
09/29/2020
Contrastive Distillation on Intermediate Representations for Language Model Compression
Existing language model compression methods mostly use a simple L2 loss ...
research
∙
09/13/2020
Cluster-Former: Clustering-based Sparse Transformer for Long-Range Dependency Encoding
Transformer has become ubiquitous in the deep learning field. One of the...
research
∙
09/10/2020
Accelerating Real-Time Question Answering via Question Generation
Existing approaches to real-time question answering (RTQA) rely on learn...
research
∙
09/10/2020
FILTER: An Enhanced Fusion Method for Cross-lingual Language Understanding
Large-scale cross-lingual language models (LM), such as mBERT, Unicoder ...
research
∙
08/31/2020
Unsupervised and Supervised Structure Learning for Protein Contact Prediction
Protein contacts provide key information for the understanding of protei...
research
∙
11/09/2019
Hierarchical Graph Network for Multi-hop Question Answering
In this paper, we present Hierarchical Graph Network (HGN) for multi-hop...
research
∙
11/01/2019
DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generation
We present a large, tunable neural conversational response generation mo...
research
∙
09/25/2019
FreeLB: Enhanced Adversarial Training for Language Understanding
Adversarial training, which minimizes the maximal risk for label-preserv...
research
∙
08/25/2019
Patient Knowledge Distillation for BERT Model Compression
Pre-trained language models such as BERT have proven to be highly effect...
research
∙
09/02/2016
Accurate De Novo Prediction of Protein Contact Map by Ultra-Deep Learning Model
Recently exciting progress has been made on protein contact prediction, ...
research
∙
02/09/2016
Graphical Model Sketch
Structured high-cardinality data arises in many domains, and poses a maj...
research
∙
11/17/2015
AUC-maximized Deep Convolutional Neural Fields for Sequence Labeling
Deep Convolutional Neural Networks (DCNN) has shown excellent performanc...
research
∙
11/12/2015
Learning Nonparametric Forest Graphical Models with Prior Information
We present a framework for incorporating prior information into nonparam...
research
∙
03/07/2015