research
∙
05/25/2023
MERGE: Fast Private Text Generation
Recent years have seen increasing concerns about the private inference o...
share
research
∙
05/25/2023
Healing Unsafe Dialogue Responses with Weak Supervision Signals
Recent years have seen increasing concerns about the unsafe response gen...
research
∙
08/30/2022
SwiftPruner: Reinforced Evolutionary Pruning for Efficient Ad Relevance
Ad relevance modeling plays a critical role in online advertising system...
research
∙
05/23/2022
A Self-Paced Mixed Distillation Method for Non-Autoregressive Generation
Non-Autoregressive generation is a sequence generation paradigm, which r...
research
∙
10/08/2021
Taming Sparsely Activated Transformer with Stochastic Experts
Sparsely activated models (SAMs), such as Mixture-of-Experts (MoE), can ...
research
∙
09/14/2021
KFCNet: Knowledge Filtering and Contrastive Learning Network for Generative Commonsense Reasoning
Pre-trained language models have led to substantial gains over a broad r...
research
∙
05/11/2021
EL-Attention: Memory Efficient Lossless Attention for Generation
Transformer model with multi-head attention requires caching intermediat...
research
∙
04/16/2021
ProphetNet-X: Large-Scale Pre-training Models for English, Chinese, Multi-lingual, Dialog, and Code Generation
Now, the pre-training technique is ubiquitous in natural language proces...
research
∙
03/25/2021
Mask Attention Networks: Rethinking and Strengthen Transformer
Transformer is an attention-based neural network, which consists of two ...
research
∙
01/15/2021
TextGNN: Improving Text Encoder via Graph Neural Network in Sponsored Search
Text encoders based on C-DSSM or transformers have demonstrated strong p...
research
∙
12/01/2020
An Enhanced Knowledge Injection Model for Commonsense Generation
Commonsense generation aims at generating plausible everyday scenario de...
research
∙
10/21/2020
ProphetNet-Ads: A Looking Ahead Strategy for Generative Retrieval Models in Sponsored Search Engine
In a sponsored search engine, generative retrieval models are recently p...
research
∙
10/14/2020
AutoADR: Automatic Model Design for Ad Relevance
Large-scale pre-trained models have attracted extensive attention in the...
research
∙
08/28/2020
HittER: Hierarchical Transformers for Knowledge Graph Embeddings
This paper examines the challenging problem of learning representations ...
research
∙
02/14/2020
TwinBERT: Distilling Knowledge to Twin-Structured BERT Models for Efficient Retrieval
Pre-trained language models like BERT have achieved great success in a w...
research
∙
01/13/2020
ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-training
In this paper, we present a new sequence-to-sequence pre-training model ...
research
∙
07/18/2017
DeepProbe: Information Directed Sequence Understanding and Chatbot Design via Recurrent Neural Networks
Information extraction and user intention identification are central top...
research
∙
03/30/2012