Change the coefficients of conditional entropies in extensivity

11/17/2020
by   Asuka Takatsu, et al.
0

The Boltzmann–Gibbs entropy is a functional on the space of probability measures. When a state space is countable, one characterization of the Boltzmann–Gibbs entropy is given by the Shannon–Khinchin axioms, which consist of continuity, maximality, expandability and extensivity. Among these four properties, the extensivity is generalized in various ways. The extensivity of a functional is interpreted as the property that, for any random variables (X,Y) taking finitely many values in ℕ, the difference between the value of the functional at the joint law of (X,Y) and that at the law of X coincides with the linear combinations of the values at the conditional laws of Y given X=n with coefficients given by the probabilities of each event X=n. A generalization of the extensivity obtained by replacing the coefficients with a power of the probabilities of the events X=n provides a characterization of the Tsallis entropy. In this paper, we first prove the impossibility to replace the coefficients with a non-power function of the probabilities of the events X=n. Then we estimate the difference between the value at the joint law of (X,Y) and that at the law of X for a general functional.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/14/2023

The algorithmic second law of thermodynamics

Gács' coarse-grained algorithmic entropy leverages universal computation...
research
07/05/2019

On the Glivenko-Cantelli theorem for the functional empirical process using associated sequences

Using a general strong law of large number proved by Sangare and Lo in ...
research
04/20/2022

An entropy functional bounded from above by one

Shannon entropy is widely used for quantifying uncertainty in discrete r...
research
12/29/2011

Multi-q Analysis of Image Patterns

This paper studies the use of the Tsallis Entropy versus the classic Bol...
research
07/14/2023

A Poisson Decomposition for Information and the Information-Event Diagram

Information diagram and the I-measure are useful mnemonics where random ...
research
07/18/2023

Isotonic Conditional Laws

We introduce Isotonic Conditional Laws (ICL) which extend the classical ...
research
03/04/2020

A homological characterization of generalized multinomial coefficients related to the entropic chain rule

There is an asymptotic relationship between the multiplicative relations...

Please sign up or login with your details

Forgot password? Click here to reset