Efficient Information Diffusion in Time-Varying Graphs through Deep Reinforcement Learning

11/27/2020
by   Matheus R. F. Mendonça, et al.
0

Network seeding for efficient information diffusion over time-varying graphs (TVGs) is a challenging task with many real-world applications. There are several ways to model this spatio-temporal influence maximization problem, but the ultimate goal is to determine the best moment for a node to start the diffusion process. In this context, we propose Spatio-Temporal Influence Maximization (STIM), a model trained with Reinforcement Learning and Graph Embedding over a set of artificial TVGs that is capable of learning the temporal behavior and connectivity pattern of each node, allowing it to predict the best moment to start a diffusion through the TVG. We also develop a special set of artificial TVGs used for training that simulate a stochastic diffusion process in TVGs, showing that the STIM network can learn an efficient policy even over a non-deterministic environment. STIM is also evaluated with a real-world TVG, where it also manages to efficiently propagate information through the nodes. Finally, we also show that the STIM model has a time complexity of O(|E|). STIM, therefore, presents a novel approach for efficient information diffusion in TVGs, being highly versatile, where one can change the goal of the model by simply changing the adopted reward function.

READ FULL TEXT
research
04/12/2019

Spatio-Temporal Deep Graph Infomax

Spatio-temporal graphs such as traffic networks or gene regulatory syste...
research
07/08/2021

CLAIM: Curriculum Learning Policy for Influence Maximization in Unknown Social Networks

Influence maximization is the problem of finding a small subset of nodes...
research
11/16/2021

Non-separable Spatio-temporal Graph Kernels via SPDEs

Gaussian processes (GPs) provide a principled and direct approach for in...
research
01/31/2023

DiffSTG: Probabilistic Spatio-Temporal Graph Forecasting with Denoising Diffusion Models

Spatio-temporal graph neural networks (STGNN) have emerged as the domina...
research
11/11/2017

STWalk: Learning Trajectory Representations in Temporal Graphs

Analyzing the temporal behavior of nodes in time-varying graphs is usefu...
research
05/24/2019

InfoRL: Interpretable Reinforcement Learning using Information Maximization

Recent advances in reinforcement learning have proved that given an envi...
research
11/24/2016

A Spatio-Temporal Representation for the Orienteering Problem with Time-Varying Profits

We consider an orienteering problem (OP) where an agent needs to visit a...

Please sign up or login with your details

Forgot password? Click here to reset