N15News: A New Dataset for Multimodal News Classification

08/30/2021
by   Zhen Wang, et al.
5

Current news datasets merely focus on text features on the news and rarely leverage the feature of images, excluding numerous essential features for news classification. In this paper, we propose a new dataset, N15News, which is generated from New York Times with 15 categories and contains both text and image information in each news. We design a novel multitask multimodal network with different fusion methods, and experiments show multimodal news classification performs better than text-only news classification. Depending on the length of the text, the classification accuracy can be increased by up to 5.8 multimodal classifier and its sub-classifiers, and also the possible improvements when applying multimodal in news classification. N15News is shown to have great potential to prompt the multimodal news studies.

READ FULL TEXT

page 2

page 3

page 4

page 5

page 6

research
04/15/2021

MM-Rec: Multimodal News Recommendation

Accurate news representation is critical for news recommendation. Most o...
research
11/15/2022

MM-Locate-News: Multimodal Focus Location Estimation in News

The consumption of news has changed significantly as the Web has become ...
research
04/25/2019

Importance of Copying Mechanism for News Headline Generation

News headline generation is an essential problem of text summarization b...
research
06/06/2022

Contrastive Graph Multimodal Model for Text Classification in Videos

The extraction of text information in videos serves as a critical step t...
research
08/20/2019

Sarcasm Detection using Hybrid Neural Network

Sarcasm Detection has enjoyed great interest from the research community...
research
12/02/2020

Classification of Multimodal Hate Speech – The Winning Solution of Hateful Memes Challenge

Hateful Memes is a new challenge set for multimodal classification, focu...
research
05/22/2022

All Birds with One Stone: Multi-task Text Classification for Efficient Inference with One Forward Pass

Multi-Task Learning (MTL) models have shown their robustness, effectiven...

Please sign up or login with your details

Forgot password? Click here to reset