Exercise? I thought you said 'Extra Fries': Leveraging Sentence Demarcations and Multi-hop Attention for Meme Affect Analysis

by   Shraman Pramanick, et al.

Today's Internet is awash in memes as they are humorous, satirical, or ironic which make people laugh. According to a survey, 33 age bracket [13-35] send memes every day, whereas more than 50 week. Some of these memes spread rapidly within a very short time-frame, and their virality depends on the novelty of their (textual and visual) content. A few of them convey positive messages, such as funny or motivational quotes; while others are meant to mock/hurt someone's feelings through sarcastic or offensive messages. Despite the appealing nature of memes and their rapid emergence on social media, effective analysis of memes has not been adequately attempted to the extent it deserves. In this paper, we attempt to solve the same set of tasks suggested in the SemEval'20-Memotion Analysis competition. We propose a multi-hop attention-based deep neural network framework, called MHA-MEME, whose prime objective is to leverage the spatial-domain correspondence between the visual modality (an image) and various textual segments to extract fine-grained feature representations for classification. We evaluate MHA-MEME on the 'Memotion Analysis' dataset for all three sub-tasks - sentiment classification, affect classification, and affect class quantification. Our comparative study shows sota performances of MHA-MEME for all three tasks compared to the top systems that participated in the competition. Unlike all the baselines which perform inconsistently across all three tasks, MHA-MEME outperforms baselines in all the tasks on average. Moreover, we validate the generalization of MHA-MEME on another set of manually annotated test samples and observe it to be consistent. Finally, we establish the interpretability of MHA-MEME.


page 2

page 10


SemEval-2020 Task 8: Memotion Analysis – The Visuo-Lingual Metaphor!

Information on social media comprises of various modalities such as text...

An AutoML-based Approach to Multimodal Image Sentiment Analysis

Sentiment analysis is a research topic focused on analysing data to extr...

How to detect novelty in textual data streams? A comparative study of existing methods

Since datasets with annotation for novelty at the document and/or word l...

Including Images into Message Veracity Assessment in Social Media

The extensive use of social media in the diffusion of information has al...

Detecting Medical Misinformation on Social Media Using Multimodal Deep Learning

In 2019, outbreaks of vaccine-preventable diseases reached the highest n...

Sentence-Level Sentiment Analysis of Financial News Using Distributed Text Representations and Multi-Instance Learning

Researchers and financial professionals require robust computerized tool...

Experiments in Detecting Persuasion Techniques in the News

Many recent political events, like the 2016 US Presidential elections or...

Please sign up or login with your details

Forgot password? Click here to reset