research
∙
09/16/2023
SLIDE: Reference-free Evaluation for Machine Translation using a Sliding Document Window
Reference-based metrics that operate at the sentence level typically out...
share
research
∙
05/26/2023
Do GPTs Produce Less Literal Translations?
Large Language Models (LLMs) such as GPT-3 have emerged as general-purpo...
research
∙
05/24/2023
Leveraging GPT-4 for Automatic Translation Post-Editing
While Neural Machine Translation (NMT) represents the leading approach t...
research
∙
02/18/2023
How Good Are GPT Models at Machine Translation? A Comprehensive Evaluation
Generative Pre-trained Transformer (GPT) models have shown remarkable ca...
research
∙
11/23/2022
Rank-One Editing of Encoder-Decoder Models
Large sequence to sequence models for tasks such as Neural Machine Trans...
research
∙
11/19/2022
Operationalizing Specifications, In Addition to Test Sets for Evaluating Constrained Generative Models
In this work, we present some recommendations on the evaluation of state...
research
∙
10/24/2022
Finding Memo: Extractive Memorization in Constrained Sequence Generation Tasks
Memorization presents a challenge for several constrained Natural Langua...
research
∙
05/20/2022
SALTED: A Framework for SAlient Long-Tail Translation Error Detection
Traditional machine translation (MT) metrics provide an average measure ...
research
∙
05/02/2021
Searchable Hidden Intermediates for End-to-End Models of Decomposable Sequence Tasks
End-to-end approaches for sequence tasks are becoming increasingly popul...
research
∙
04/14/2021
The Curious Case of Hallucinations in Neural Machine Translation
In this work, we study hallucinations in Neural Machine Translation (NMT...
research
∙
02/02/2021
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics
We introduce GEM, a living benchmark for natural language Generation (NL...
research
∙
11/04/2019
On Compositionality in Neural Machine Translation
We investigate two specific manifestations of compositionality in Neural...
research
∙
10/07/2019
On Leveraging the Visual Modality for Neural Machine Translation
Leveraging the visual modality effectively for Neural Machine Translatio...
research
∙
10/05/2019
On Dimensional Linguistic Properties of the Word Embedding Space
Word embeddings have become a staple of several natural language process...
research
∙
02/18/2019
Learned In Speech Recognition: Contextual Acoustic Word Embeddings
End-to-end acoustic-to-word speech recognition models have recently gain...
research
∙
08/11/2017