research
∙
08/09/2023
Cross-Lingual Constituency Parsing for Middle High German: A Delexicalized Approach
Constituency parsing plays a fundamental role in advancing natural langu...
share
research
∙
07/15/2023
Is Prompt-Based Finetuning Always Better than Vanilla Finetuning? Insights from Cross-Lingual Language Understanding
Multilingual pretrained language models (MPLMs) have demonstrated substa...
research
∙
06/26/2023
Towards Language-Based Modulation of Assistive Robots through Multimodal Models
In the field of Geriatronics, enabling effective and transparent communi...
research
∙
06/16/2023
Politeness Stereotypes and Attack Vectors: Gender Stereotypes in Japanese and Korean Language Models
In efforts to keep up with the rapid progress and use of large language ...
research
∙
05/26/2023
On the Copying Problem of Unsupervised NMT: A Training Schedule with a Language Discriminator Loss
Although unsupervised neural machine translation (UNMT) has achieved suc...
research
∙
05/24/2023
How to Distill your BERT: An Empirical Study on the Impact of Weight Initialisation and Distillation Objectives
Recently, various intermediate layer distillation (ILD) objectives have ...
research
∙
05/24/2023
Evaluate What You Can't Evaluate: Unassessable Generated Responses Quality
LLMs (large language models) such as ChatGPT have shown remarkable langu...
research
∙
05/23/2023
RET-LLM: Towards a General Read-Write Memory for Large Language Models
Large language models (LLMs) have significantly advanced the field of na...
research
∙
05/23/2023
Language Models with Rationality
While large language models (LLMs) are proficient at question-answering ...
research
∙
05/22/2023
A study of conceptual language similarity: comparison and evaluation
An interesting line of research in natural language processing (NLP) aim...
research
∙
05/22/2023
Language-Agnostic Bias Detection in Language Models
Pretrained language models (PLMs) are key components in NLP, but they co...
research
∙
05/22/2023
Crosslingual Transfer Learning for Low-Resource Languages Based on Multilingual Colexification Graphs
Colexification in comparative linguistics refers to the phenomenon of a ...
research
∙
05/20/2023
Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages
The NLP community has mainly focused on scaling Large Language Models (L...
research
∙
05/15/2023
Taxi1500: A Multilingual Dataset for Text Classification in 1500 Languages
While natural language processing tools have been developed extensively ...
research
∙
05/15/2023
A Crosslingual Investigation of Conceptualization in 1335 Languages
Languages differ in how they divide up the world into concepts and words...
research
∙
04/28/2023
NLNDE at SemEval-2023 Task 12: Adaptive Pretraining and Source Language Selection for Low-Resource Multilingual Sentiment Analysis
This paper describes our system developed for the SemEval-2023 Task 12 "...
research
∙
04/20/2023
Does Manipulating Tokenization Aid Cross-Lingual Transfer? A Study on POS Tagging for Non-Standardized Languages
One of the challenges with finetuning pretrained language models (PLMs) ...
research
∙
04/19/2023
A Survey of Corpora for Germanic Low-Resource Languages and Dialects
Despite much progress in recent years, the vast majority of work in natu...
research
∙
04/17/2023
LongForm: Optimizing Instruction Tuning for Long Text Generation with Corpus Extraction
Instruction tuning enables language models to generalize more effectivel...
research
∙
04/04/2023
Sociocultural knowledge is needed for selection of shots in hate speech detection tasks
We introduce HATELEXICON, a lexicon of slurs and targets of hate speech ...
research
∙
03/16/2023
GIRT-Data: Sampling GitHub Issue Report Templates
GitHub's issue reports provide developers with valuable information that...
research
∙
03/08/2023
MenuCraft: Interactive Menu System Design with Large Language Models
Menu system design is a challenging task involving many design options a...
research
∙
02/04/2023
Construction Grammar Provides Unique Insight into Neural Language Models
Construction Grammar (CxG) has recently been used as the basis for probi...
research
∙
12/19/2022
Cross-Lingual Retrieval Augmented Prompt for Low-Resource Languages
Multilingual Pretrained Language Models (MPLMs) have shown their strong ...
research
∙
12/18/2022
PVGRU: Generating Diverse and Relevant Dialogue Responses via Pseudo-Variational Mechanism
We investigate response generation for multi-turn dialogue in generative...
research
∙
12/14/2022
Unsupervised Detection of Contextualized Embedding Bias with Application to Ideology
We propose a fully unsupervised method to detect bias in contextualized ...
research
∙
11/15/2022
MEAL: Stable and Active Learning for Few-Shot Prompting
Few-shot classification in NLP has recently made great strides due to th...
research
∙
10/25/2022
This joke is [MASK]: Recognizing Humor and Offense with Prompting
Humor is a magnetic component in everyday human interactions and communi...
research
∙
10/24/2022
The Better Your Syntax, the Better Your Semantics? Probing Pretrained Language Models for the English Comparative Correlative
Construction Grammar (CxG) is a paradigm from cognitive linguistics emph...
research
∙
10/18/2022
Graph-Based Multilingual Label Propagation for Low-Resource Part-of-Speech Tagging
Part-of-Speech (POS) tagging is an important component of the NLP pipeli...
research
∙
10/12/2022
SilverAlign: MT-Based Silver Data Algorithm For Evaluating Word Alignment
Word alignments are essential for a variety of NLP tasks. Therefore, cho...
research
∙
10/12/2022
Federated Continual Learning for Text Classification via Selective Inter-client Transfer
In this work, we combine the two paradigms: Federated Learning (FL) and ...
research
∙
09/26/2022
Modeling Content-Emotion Duality via Disentanglement for Empathetic Conversation
The task of empathetic response generation aims to understand what feeli...
research
∙
07/28/2022
Measuring Causal Effects of Data Statistics on Language Model's `Factual' Predictions
Large amounts of training data are one of the major reasons for the high...
research
∙
05/31/2022
Don't Forget Cheap Training Signals Before Building Unsupervised Bilingual Word Embeddings
Bilingual Word Embeddings (BWEs) are one of the cornerstones of cross-li...
research
∙
05/13/2022
Analyzing Hate Speech Data along Racial, Gender and Intersectional Axes
To tackle the rising phenomenon of hate speech, efforts have been made t...
research
∙
04/26/2022
Flow-Adapter Architecture for Unsupervised Machine Translation
In this work, we propose a flow-adapter architecture for unsupervised NM...
research
∙
03/31/2022
Domain Adaptation for Sparse-Data Settings: What Do We Gain by Not Using Bert?
The practical success of much of NLP depends on the availability of trai...
research
∙
03/18/2022
CaMEL: Case Marker Extraction without Labels
We introduce CaMEL (Case Marker Extraction without Labels), a novel and ...
research
∙
03/17/2022
Enhanced Temporal Knowledge Embeddings with Contextualized Language Representations
With the emerging research effort to integrate structured and unstructur...
research
∙
03/16/2022
Graph Neural Networks for Multiparallel Word Alignment
After a period of decrease, interest in word alignments is increasing ag...
research
∙
03/16/2022
Geographic Adaptation of Pretrained Language Models
Geographic linguistic features are commonly used to improve the performa...
research
∙
03/15/2022
Modular and Parameter-Efficient Multimodal Fusion with Prompting
Recent research has made impressive progress in large-scale multimodal p...
research
∙
03/11/2022
CoDA21: Evaluating Language Understanding Capabilities of NLP Models With Context-Definition Alignment
Pretrained language models (PLMs) have achieved superhuman performance o...
research
∙
02/12/2022
Semantic-Oriented Unlabeled Priming for Large-Scale Language Models
Due to the high costs associated with finetuning large language models, ...
research
∙
01/28/2022
Towards a Broad Coverage Named Entity Resource: A Data-Efficient Approach for Many Diverse Languages
Parallel corpora are ideal for extracting a multilingual named entity (M...
research
∙
11/26/2021
True Few-Shot Learning with Prompts – A Real-World Perspective
Prompt-based approaches are strong at few-shot learning. However, Perez ...
research
∙
09/29/2021
BeliefBank: Adding Memory to a Pre-Trained Language Model for a Systematic Notion of Belief
Although pretrained language models (PTLMs) contain significant amounts ...
research
∙
09/28/2021
Active Learning for Argument Mining: A Practical Approach
Despite considerable recent progress, the creation of well-balanced and ...
research
∙
09/23/2021