research
∙
09/14/2023
ChatGPT MT: Competitive for High- (but not Low-) Resource Languages
Large language models (LLMs) implicitly learn to perform a range of lang...
share
research
∙
08/23/2023
Prompt2Model: Generating Deployable Models from Natural Language Instructions
Large language models (LLMs) enable system builders today to create comp...
research
∙
08/14/2023
The Devil is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluation
Automatic evaluation of machine translation (MT) is a critical tool driv...
research
∙
07/25/2023
FacTool: Factuality Detection in Generative AI – A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarios
The emergence of generative pre-trained models has facilitated the synth...
research
∙
07/10/2023
Improving Factuality of Abstractive Summarization via Contrastive Reward Learning
Modern abstractive summarization models often generate summaries that co...
research
∙
07/02/2023
Large Language Models Enable Few-Shot Clustering
Unlike traditional unsupervised clustering, semi-supervised clustering a...
research
∙
06/11/2023
Neural Machine Translation for the Indigenous Languages of the Americas: An Introduction
Neural models have drastically advanced state of the art for machine tra...
research
∙
06/01/2023
Multi-Dimensional Evaluation of Text Summarization with In-Context Learning
Evaluation of natural language generation (NLG) is complex and multi-dim...
research
∙
05/29/2023
Syntax and Semantics Meet in the "Middle": Probing the Syntax-Semantics Interface of LMs Through Agentivity
Recent advances in large language models have prompted researchers to ex...
research
∙
05/26/2023
DataFinder: Scientific Dataset Recommendation from Natural Language Descriptions
Modern machine learning relies on datasets to develop and validate resea...
research
∙
05/25/2023
Multi-lingual and Multi-cultural Figurative Language Understanding
Figurative language permeates human communication, but at the same time ...
research
∙
05/24/2023
GlobalBench: A Benchmark for Global Progress in Natural Language Processing
Despite the major advances in NLP, significant disparities in NLP system...
research
∙
05/19/2023
Solving NLP Problems through Human-System Collaboration: A Discussion-based Approach
Humans work together to solve common problems by having discussions, exp...
research
∙
05/11/2023
Active Retrieval Augmented Generation
Despite the remarkable ability of large language models (LMs) to compreh...
research
∙
05/02/2023
Unlimiformer: Long-Range Transformers with Unlimited Length Input
Transformer-based models typically have a predefined bound to their inpu...
research
∙
05/01/2023
Bridging the Gap: A Survey on Integrating (Human) Feedback for Natural Language Generation
Many recent advances in natural language generation have been fueled by ...
research
∙
03/23/2023
A Gold Standard Dataset for the Reviewer Assignment Problem
Many peer-review venues are either using or looking to use algorithms to...
research
∙
02/26/2023
User-Centric Evaluation of OCR Systems for Kwak'wala
There has been recent interest in improving optical character recognitio...
research
∙
02/15/2023
Learning Performance-Improving Code Edits
The waning of Moore's Law has shifted the focus of the tech industry tow...
research
∙
02/11/2023
Cross-Modal Fine-Tuning: Align then Refine
Fine-tuning large-scale pretrained models has led to tremendous progress...
research
∙
02/10/2023
CodeBERTScore: Evaluating Code Generation with Pretrained Models of Code
Since the rise of neural models of code that can generate long expressio...
research
∙
01/07/2023
Why do Nearest Neighbor Language Models Work?
Language models (LMs) compute the probability of a text by sequentially ...
research
∙
12/21/2022
Beyond Contrastive Learning: A Variational Generative Model for Multilingual Retrieval
Contrastive learning has been successfully used for retrieval of semanti...
research
∙
12/20/2022
Execution-Based Evaluation for Open-Domain Code Generation
To extend the scope of coding queries to more realistic settings, we pro...
research
∙
12/19/2022
NusaCrowd: Open Source Initiative for Indonesian NLP Resources
We present NusaCrowd, a collaborative initiative to collect and unite ex...
research
∙
12/12/2022
Searching for Effective Multilingual Fine-Tuning Methods: A Case Study in Summarization
Recently, a large number of tuning strategies have been proposed to adap...
research
∙
12/12/2022
T5Score: Discriminative Fine-tuning of Generative Evaluation Metrics
Modern embedding-based metrics for evaluation of generated text generall...
research
∙
12/05/2022
Retrieval as Attention: End-to-end Learning of Retrieval and Reading within a Single Transformer
Systems for knowledge-intensive tasks such as open-domain question answe...
research
∙
11/18/2022
PAL: Program-aided Language Models
Large language models (LLMs) have recently demonstrated an impressive ab...
research
∙
11/11/2022
English Contrastive Learning Can Learn Universal Cross-lingual Sentence Embeddings
Universal cross-lingual sentence embeddings map semantically similar cro...
research
∙
10/30/2022
DiffusER: Discrete Diffusion via Edit-based Reconstruction
In text generation, models that generate text from scratch one token at ...
research
∙
10/27/2022
He Said, She Said: Style Transfer for Shifting the Perspective of Dialogues
In this work, we define a new style transfer task: perspective shift, wh...
research
∙
10/13/2022
Language Models of Code are Few-Shot Commonsense Learners
We address the general task of structured commonsense reasoning: given a...
research
∙
10/13/2022
A Multi-dimensional Evaluation of Tokenizer-free Multilingual Pretrained Models
Recent work on tokenizer-free multilingual pretrained models show promis...
research
∙
10/11/2022
CTC Alignments Improve Autoregressive Translation
Connectionist Temporal Classification (CTC) is a widely used approach fo...
research
∙
10/09/2022
Understanding and Improving Zero-shot Multi-hop Reasoning in Generative Question Answering
Generative question answering (QA) models generate answers to questions ...
research
∙
10/07/2022
Are Representations Built from the Ground Up? An Empirical Examination of Local Composition in Language Models
Compositionality, the phenomenon where the meaning of a phrase can be de...
research
∙
09/21/2022
Mega: Moving Average Equipped Gated Attention
The design choices in the Transformer attention mechanism, including wea...
research
∙
08/23/2022
KGxBoard: Explainable and Interactive Leaderboard for Evaluation of Knowledge Graph Completion Models
Knowledge Graphs (KGs) store information in the form of (head, predicate...
research
∙
07/13/2022
DocCoder: Generating Code by Retrieving and Reading Docs
Natural-language-to-code models learn to generate a code snippet given a...
research
∙
07/08/2022
OmniTab: Pretraining with Natural and Synthetic Data for Few-shot Table-based Question Answering
The information in tables can be an important complement to text, making...
research
∙
07/01/2022
Building African Voices
Modern speech synthesis techniques can produce natural-sounding speech g...
research
∙
06/10/2022
Teacher Perception of Automatically Extracted Grammar Concepts for L2 Language Learning
One of the challenges of language teaching is how to organize the rules ...
research
∙
05/27/2022
AANG: Automating Auxiliary Learning
When faced with data-starved or highly complex end-tasks, it is commonpl...
research
∙
05/24/2022
Learning to Model Editing Processes
Most existing sequence generation models produce outputs in one pass, us...
research
∙
05/19/2022
Table Retrieval May Not Necessitate Table-specific Model Design
Tables are an important form of structured data for both human and machi...
research
∙
05/02/2022
Quality-Aware Decoding for Neural Machine Translation
Despite the progress in machine translation quality estimation and evalu...
research
∙
04/29/2022
Prompt Consistency for Zero-Shot Task Generalization
One of the most impressive results of recent NLP history is the ability ...
research
∙
04/26/2022
Testing the Ability of Language Models to Interpret Figurative Language
Figurative and metaphorical language are commonplace in discourse, and f...
research
∙
04/22/2022