OCHADAI at SemEval-2022 Task 2: Adversarial Training for Multilingual Idiomaticity Detection

06/07/2022
by   Lis Kanashiro Pereira, et al.
0

We propose a multilingual adversarial training model for determining whether a sentence contains an idiomatic expression. Given that a key challenge with this task is the limited size of annotated data, our model relies on pre-trained contextual representations from different multi-lingual state-of-the-art transformer-based language models (i.e., multilingual BERT and XLM-RoBERTa), and on adversarial training, a training method for further enhancing model generalization and robustness. Without relying on any human-crafted features, knowledge bases, or additional datasets other than the target datasets, our model achieved competitive results and ranked 6th place in SubTask A (zero-shot) setting and 15th place in SubTask A (one-shot) setting.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/12/2021

OCHADAI-KYODAI at SemEval-2021 Task 1: Enhancing Model Generalization and Robustness for Lexical Complexity Prediction

We propose an ensemble model for predicting the lexical complexity of wo...
research
12/10/2020

Multilingual Transfer Learning for QA Using Translation as Data Augmentation

Prior work on multilingual question answering has mostly focused on usin...
research
08/13/2020

ANDES at SemEval-2020 Task 12: A jointly-trained BERT multilingual model for offensive language detection

This paper describes our participation in SemEval-2020 Task 12: Multilin...
research
04/22/2023

Romanian Multiword Expression Detection Using Multilingual Adversarial Training and Lateral Inhibition

Multiword expressions are a key ingredient for developing large-scale an...
research
08/23/2022

Predicting Query-Item Relationship using Adversarial Training and Robust Modeling Techniques

We present an effective way to predict search query-item relationship. W...
research
05/17/2020

Adversarial Training for Commonsense Inference

We propose an AdversariaL training algorithm for commonsense InferenCE (...
research
09/08/2020

kk2018 at SemEval-2020 Task 9: Adversarial Training for Code-Mixing Sentiment Classification

Code switching is a linguistic phenomenon that may occur within a multil...

Please sign up or login with your details

Forgot password? Click here to reset