Minimizing couplings in renormalization by preserving short-range mutual information

07/02/2021
by   Christian Bertoni, et al.
0

The connections between renormalization in statistical mechanics and information theory are intuitively evident, but a satisfactory theoretical treatment remains elusive. Recently, Koch-Janusz and Ringel proposed selecting a real-space renormalization map for classical lattice systems by minimizing the loss of long-range mutual information [Nat. Phys. 14, 578 (2018)]. The success of this technique has been related in part to the minimization of long-range couplings in the renormalized Hamiltonian [Lenggenhager et al., Phys. Rev. X 10, 011037 (2020)]. We show that to minimize these couplings the renormalization map should, somewhat counterintuitively, instead be chosen to minimize the loss of short-range mutual information between a block and its boundary. Moreover, the previous minimization is a relaxation of this approach, which indicates that the aims of preserving long-range physics and eliminating short-range couplings are related in a nontrivial way.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/28/2019

Better Long-Range Dependency By Bootstrapping A Mutual Information Regularizer

In this work, we develop a novel regularizer to improve the learning of ...
research
05/10/2019

Mutual Information Scaling and Expressive Power of Sequence Models

Sequence models assign probabilities to variable-length sequences such a...
research
01/31/2013

Equitability, mutual information, and the maximal information coefficient

Reshef et al. recently proposed a new statistical measure, the "maximal ...
research
06/11/2018

Chaining Mutual Information and Tightening Generalization Bounds

Bounding the generalization error of learning algorithms has a long hist...
research
05/08/2019

Data-Efficient Mutual Information Neural Estimator

Measuring Mutual Information (MI) between high-dimensional, continuous, ...
research
06/21/2016

Criticality in Formal Languages and Statistical Physics

We show that the mutual information between two symbols, as a function o...
research
08/13/2018

Stealth Attacks on the Smart Grid

Random attacks that jointly minimize the amount of information acquired ...

Please sign up or login with your details

Forgot password? Click here to reset