Learning to Generalize for Cross-domain QA

by   Yingjie Niu, et al.
University College Dublin

There have been growing concerns regarding the out-of-domain generalization ability of natural language processing (NLP) models, particularly in question-answering (QA) tasks. Current synthesized data augmentation methods for QA are hampered by increased training costs. To address this issue, we propose a novel approach that combines prompting methods and linear probing then fine-tuning strategy, which does not entail additional cost. Our method has been theoretically and empirically shown to be effective in enhancing the generalization ability of both generative and discriminative models. Our approach outperforms state-of-the-art baselines, with an average increase in F1 score of 4.5 pre-trained models and offers a promising solution to the under-explored cross-domain QA task. We release our source code at GitHub*.


A Comparative Study of Transformer-Based Language Models on Extractive Question Answering

Question Answering (QA) is a task in natural language processing that ha...

UnifiedQA-v2: Stronger Generalization via Broader Cross-Format Training

We present UnifiedQA-v2, a QA model built with the same process as Unifi...

A Pipeline for Generating, Annotating and Employing Synthetic Data for Real World Question Answering

Question Answering (QA) is a growing area of research, often used to fac...

General Framework for Self-Supervised Model Priming for Parameter-Efficient Fine-tuning

Parameter-efficient methods (like Prompt or Adapters) for adapting pre-t...

Generative Data Augmentation using LLMs improves Distributional Robustness in Question Answering

Robustness in Natural Language Processing continues to be a pertinent is...

Transferability of Natural Language Inference to Biomedical Question Answering

Biomedical question answering (QA) is a challenging problem due to the s...

Learning Vector-Quantized Item Representation for Transferable Sequential Recommenders

Recently, the generality of natural language text has been leveraged to ...

Please sign up or login with your details

Forgot password? Click here to reset