Generating Scientific Claims for Zero-Shot Scientific Fact Checking

03/24/2022
by   Dustin Wright, et al.
5

Automated scientific fact checking is difficult due to the complexity of scientific language and a lack of significant amounts of training data, as annotation requires domain expertise. To address this challenge, we propose scientific claim generation, the task of generating one or more atomic and verifiable claims from scientific sentences, and demonstrate its usefulness in zero-shot fact checking for biomedical claims. We propose CLAIMGEN-BART, a new supervised method for generating claims supported by the literature, as well as KBIN, a novel method for generating claim negations. Additionally, we adapt an existing unsupervised entity-centric method of claim generation to biomedical claims, which we call CLAIMGEN-ENTITY. Experiments on zero-shot fact checking demonstrate that both CLAIMGEN-ENTITY and CLAIMGEN-BART, coupled with KBIN, achieve up to 90 annotated claims and evidence. A rigorous evaluation study demonstrates significant improvement in generated claim and negation quality over existing baselines

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/31/2021

Zero-shot Fact Verification by Claim Generation

Neural models for automated fact verification have achieved promising re...
research
12/16/2021

NewsClaims: A New Benchmark for Claim Detection from News with Background Knowledge

Claim detection and verification are crucial for news understanding and ...
research
07/24/2017

Extracting Core Claims from Scientific Articles

The number of scientific articles has grown rapidly over the years and t...
research
04/13/2020

Generating Fact Checking Explanations

Most existing work on automated fact checking is concerned with predicti...
research
06/01/2021

Claim Matching Beyond English to Scale Global Fact-Checking

Manual fact-checking does not scale well to serve the needs of the inter...
research
05/11/2022

Aggregating Pairwise Semantic Differences for Few-Shot Claim Veracity Classification

As part of an automated fact-checking pipeline, the claim veracity class...
research
09/16/2022

Entity-based Claim Representation Improves Fact-Checking of Medical Content in Tweets

False medical information on social media poses harm to people's health....

Please sign up or login with your details

Forgot password? Click here to reset