Towards Better Graph Representation: Two-Branch Collaborative Graph Neural Networks for Multimodal Marketing Intention Detection

05/13/2020
by   Lu Zhang, et al.
11

Inspired by the fact that spreading and collecting information through the Internet becomes the norm, more and more people choose to post for-profit contents (images and texts) in social networks. Due to the difficulty of network censors, malicious marketing may be capable of harming society. Therefore, it is meaningful to detect marketing intentions online automatically. However, gaps between multimodal data make it difficult to fuse images and texts for content marketing detection. To this end, this paper proposes Two-Branch Collaborative Graph Neural Networks to collaboratively represent multimodal data by Graph Convolution Networks (GCNs) in an end-to-end fashion. We first separately embed groups of images and texts by GCNs layers from two views and further adopt the proposed multimodal fusion strategy to learn the graph representation collaboratively. Experimental results demonstrate that our proposed method achieves superior graph classification performance for marketing intention detection.

READ FULL TEXT
research
06/10/2022

Transformer-Graph Neural Network with Global-Local Attention for Multimodal Rumour Detection with Knowledge Distillation

Misinformation spreading becomes a critical issue in online conversation...
research
08/13/2022

ULDGNN: A Fragmented UI Layer Detector Based on Graph Neural Networks

While some work attempt to generate front-end code intelligently from UI...
research
02/05/2021

Self-Supervised Deep Graph Embedding with High-Order Information Fusion for Community Discovery

Deep graph embedding is an important approach for community discovery. D...
research
04/19/2022

Multimodal Hate Speech Detection from Bengali Memes and Texts

Numerous works have been proposed to employ machine learning (ML) and de...
research
12/21/2019

Multimodal Representation Model based on Graph-Based Rank Fusion

This paper proposes an unsupervised representation model, based on rank-...
research
09/03/2023

End-to-End Learning on Multimodal Knowledge Graphs

Knowledge graphs enable data scientists to learn end-to-end on heterogen...
research
03/25/2020

End-to-End Entity Classification on Multimodal Knowledge Graphs

End-to-end multimodal learning on knowledge graphs has been left largely...

Please sign up or login with your details

Forgot password? Click here to reset