research
∙
09/16/2023
Sorted LLaMA: Unlocking the Potential of Intermediate Layers of Large Language Models for Dynamic Inference Using Sorted Fine-Tuning (SoFT)
The rapid advancement of large language models (LLMs) has revolutionized...
share
research
∙
09/01/2023
SortedNet, a Place for Every Network and Every Network in its Place: Towards a Generalized Solution for Training Many-in-One Neural Networks
As the size of deep learning models continues to grow, finding optimal m...
research
∙
05/23/2023
On the Transferability of Whisper-based Representations for "In-the-Wild" Cross-Task Downstream Speech Applications
Large self-supervised pre-trained speech models have achieved remarkable...
research
∙
03/28/2023
One Adapter for All Programming Languages? Adapter Tuning for Code Search and Summarization
As pre-trained models automate many code intelligence tasks, a widely us...
research
∙
03/28/2023
Translate the Beauty in Songs: Jointly Learning to Align Melody and Translate Lyrics
Song translation requires both translation of lyrics and alignment of mu...
research
∙
03/24/2023
Mathematical Challenges in Deep Learning
Deep models are dominating the artificial intelligence (AI) industry sin...
research
∙
03/14/2023
Adapting Offline Speech Translation Models for Streaming with Future-Aware Distillation and Inference
A popular approach to streaming speech translation is to employ a single...
research
∙
02/18/2023
RobustDistiller: Compressing Universal Speech Representations for Enhanced Environment Robustness
Self-supervised speech pre-training enables deep neural network models t...
research
∙
05/23/2022
Non-Parametric Domain Adaptation for End-to-End Speech Translation
End-to-End Speech Translation (E2E-ST) has received increasing attention...
research
∙
04/28/2022
Tailor: A Prompt-Based Approach to Attribute-Based Controlled Text Generation
Attribute-based Controlled Text Generation (CTG) refers to generating se...
research
∙
04/28/2022
Attention Mechanism with Energy-Friendly Operations
Attention mechanism has become the dominant module in natural language p...
research
∙
04/28/2022
RoBLEURT Submission for the WMT2021 Metrics Task
In this paper, we present our submission to Shared Metrics Task: RoBLEUR...
research
∙
04/28/2022
UniTE: Unified Translation Evaluation
Translation quality evaluation plays a crucial role in machine translati...
research
∙
04/13/2022
Efficient Cluster-Based k-Nearest-Neighbor Machine Translation
k-Nearest-Neighbor Machine Translation (kNN-MT) has been recently propos...
research
∙
12/30/2021
QEMind: Alibaba's Submission to the WMT21 Quality Estimation Shared Task
Quality Estimation, as a crucial step of quality control for machine tra...
research
∙
12/21/2021
Regularizing End-to-End Speech Translation with Triangular Decomposition Agreement
End-to-end speech-to-text translation (E2E-ST) is becoming increasingly ...
research
∙
09/14/2021
Non-Parametric Unsupervised Domain Adaptation for Neural Machine Translation
Recently, kNN-MT has shown the promising capability of directly incorpor...
research
∙
09/10/2021
Rethinking Zero-shot Neural Machine Translation: From a Perspective of Latent Variables
Zero-shot translation, directly translating between language pairs unsee...
research
∙
08/31/2021
Task-Oriented Dialogue System as Natural Language Generation
In this paper, we propose to formulate the task-oriented dialogue system...
research
∙
05/31/2021
G-Transformer for Document-level Machine Translation
Document-level MT models are still far from satisfactory. Existing work ...
research
∙
05/27/2021
Adaptive Nearest Neighbor Machine Translation
kNN-MT, recently proposed by Khandelwal et al. (2020a), successfully com...
research
∙
04/16/2021
Towards Variable-Length Textual Adversarial Attacks
Adversarial attacks have shown the vulnerability of machine learning mod...
research
∙
10/26/2020
Exploiting Neural Query Translation into Cross Lingual Information Retrieval
As a crucial role in cross-language information retrieval (CLIR), query ...
research
∙
10/26/2020
Constraint Translation Candidates: A Bridge between Neural Query Translation and Cross-lingual Information Retrieval
Query translation (QT) is a key component in cross-lingual information r...
research
∙
10/13/2020
Incorporating BERT into Parallel Sequence Decoding with Adapters
While large scale pre-trained language models such as BERT have achieved...
research
∙
10/09/2020
Self-Paced Learning for Neural Machine Translation
Recent studies have proven that the training of neural machine translati...
research
∙
10/06/2020
Iterative Domain-Repaired Back-Translation
In this paper, we focus on the domain-specific translation with low reso...
research
∙
09/19/2020
Long-Short Term Masking Transformer: A Simple but Effective Baseline for Document-level Neural Machine Translation
Many document-level neural machine translation (NMT) systems have explor...
research
∙
07/06/2020
Bilingual Dictionary Based Neural Machine Translation without Using Parallel Sentences
In this paper, we propose a new task of machine translation (MT), which ...
research
∙
12/27/2019
Visual Agreement Regularized Training for Multi-Modal Machine Translation
Multi-modal machine translation aims at translating the source sentence ...
research
∙
12/03/2019
Cross-lingual Pre-training Based Transfer for Zero-shot Neural Machine Translation
Transfer learning between different language pairs has shown its effecti...
research
∙
10/03/2019
Neural Zero-Inflated Quality Estimation Model For Automatic Speech Recognition System
The performances of automatic speech recognition (ASR) systems are usual...
research
∙
06/13/2019
