research
∙
08/22/2023
SeamlessM4T-Massively Multilingual Multimodal Machine Translation
What does it take to create the Babel Fish, a tool that can help individ...
share
research
∙
05/04/2023
Hybrid Transducer and Attention based Encoder-Decoder Modeling for Speech-to-Text Tasks
Transducer and Attention based Encoder-Decoder (AED) are two widely used...
research
∙
10/15/2021
Direct simultaneous speech to speech translation
We present the first direct simultaneous speech-to-speech translation (S...
research
∙
10/15/2021
Incremental Speech Synthesis For Speech-To-Speech Translation
In a speech-to-speech translation (S2ST) pipeline, the text-to-speech (T...
research
∙
07/12/2021
Direct speech-to-speech translation with discrete units
We present a direct speech-to-speech translation (S2ST) model that trans...
research
∙
11/03/2020
SimulMT to SimulST: Adapting Simultaneous Text Translation to End-to-End Simultaneous Speech Translation
Simultaneous text translation and end-to-end speech translation have rec...
research
∙
10/30/2020
Streaming Simultaneous Speech Translation with Augmented Memory Transformer
Transformer-based models have achieved state-of-the-art performance on s...
research
∙
10/21/2020
A General Multi-Task Learning Framework to Leverage Text Data for Speech to Text Tasks
Attention-based sequence-to-sequence modeling provides a powerful and el...
research
∙
10/11/2020
fairseq S2T: Fast Speech-to-Text Modeling with fairseq
We introduce fairseq S2T, a fairseq extension for speech-to-text (S2T) m...
research
∙
07/31/2020
SimulEval: An Evaluation Toolkit for Simultaneous Translation
Simultaneous translation on both text and speech focuses on a real-time ...
research
∙
06/03/2020
Self-Training for End-to-End Speech Translation
One of the main challenges for end-to-end speech translation is data sca...
research
∙
09/26/2019
Monotonic Multihead Attention
Simultaneous machine translation models start generating a target sequen...
research
∙
09/14/2019
Harnessing Indirect Training Data for End-to-End Automatic Speech Translation: Tricks of the Trade
For automatic speech translation (AST), end-to-end approaches are outper...
research
∙
09/14/2019
Leveraging Out-of-Task Data for End-to-End Automatic Speech Translation
For automatic speech translation (AST), end-to-end approaches are outper...
research
∙
09/05/2019
Broad-Coverage Semantic Parsing as Transduction
We unify different broad-coverage semantic parsing tasks under a transdu...
research
∙
05/21/2019