RFiD: Towards Rational Fusion-in-Decoder for Open-Domain Question Answering

by   Cunxiang Wang, et al.

Open-Domain Question Answering (ODQA) systems necessitate a reader model capable of generating answers by simultaneously referring to multiple passages. Although representative models like Fusion-in-Decoder (FiD) have been proposed to address this challenge, these systems can inadvertently rely on spurious features instead of genuine causal relationships between the question and the passages to generate answers. To counter this problem, we introduce the Rational Fusion-in-Decoder (RFiD) model. Our model leverages the encoders of FiD to differentiate between causal relationships and spurious features, subsequently guiding the decoder to generate answers informed by this discernment. Experimental results on two ODQA datasets, Natural Questions (NQ) and TriviaQA (TQ), demonstrate that our model surpasses previous methods, achieving improvements of up to 1.5 and 0.7 in Exact Match scores on NQ, and exhibits an enhanced ability to identify causal relationships.


page 1

page 2

page 3

page 4


Dynamic Coattention Networks For Question Answering

Several deep learning models have been proposed for question answering. ...

FiE: Building a Global Probability Space by Leveraging Early Fusion in Encoder for Open-Domain Question Answering

Generative models have recently started to outperform extractive models ...

Exploiting Abstract Meaning Representation for Open-Domain Question Answering

The Open-Domain Question Answering (ODQA) task involves retrieving and s...

Model Analysis Evaluation for Ambiguous Question Answering

Ambiguous questions are a challenge for Question Answering models, as th...

Prompt Guided Copy Mechanism for Conversational Question Answering

Conversational Question Answering (CQA) is a challenging task that aims ...

Question and Answer Test-Train Overlap in Open-Domain Question Answering Datasets

Ideally Open-Domain Question Answering models should exhibit a number of...

Open-WikiTable: Dataset for Open Domain Question Answering with Complex Reasoning over Table

Despite recent interest in open domain question answering (ODQA) over ta...

Please sign up or login with your details

Forgot password? Click here to reset