On the information-theoretic formulation of network participation

07/24/2023
by   Pavle Cajic, et al.
0

The participation coefficient is a widely used metric of the diversity of a node's connections with respect to a modular partition of a network. An information-theoretic formulation of this concept of connection diversity, referred to here as participation entropy, has been introduced as the Shannon entropy of the distribution of module labels across a node's connected neighbors. While diversity metrics have been studied theoretically in other literatures, including to index species diversity in ecology, many of these results have not previously been applied to networks. Here we show that the participation coefficient is a first-order approximation to participation entropy and use the desirable additive properties of entropy to develop new metrics of connection diversity with respect to multiple labelings of nodes in a network, as joint and conditional participation entropies. The information-theoretic formalism developed here allows new and more subtle types of nodal connection patterns in complex networks to be studied.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/31/2023

Bayesian estimation of information-theoretic metrics for sparsely sampled distributions

Estimating the Shannon entropy of a discrete distribution from which we ...
research
07/27/2022

Informational properties of the family of cubic rank transmuted distributions

Recently, cubic rank transmuted (CRT) distribution was introduced and st...
research
01/16/2013

Information Theoretic Learning with Infinitely Divisible Kernels

In this paper, we develop a framework for information theoretic learning...
research
07/07/2020

Information-theoretic convergence of extreme values to the Gumbel distribution

We show how convergence to the Gumbel distribution in an extreme value s...
research
02/13/2021

Fluctuation-response theorem for Kullback-Leibler divergences to quantify causation

We define a new measure of causation from a fluctuation-response theorem...
research
04/07/2020

A System of Billiard and Its Application to Information-Theoretic Entropy

In this article, we define an information-theoretic entropy based on the...

Please sign up or login with your details

Forgot password? Click here to reset