Emergence of a finite-size-scaling function in the supervised learning of the Ising phase transition

10/01/2020
by   Dongkyu Kim, et al.
6

We investigate the connection between the supervised learning of the binary phase classification in the ferromagnetic Ising model and the standard finite-size-scaling theory of the second-order phase transition. Proposing a minimal one-free-parameter neural network model, we analytically formulate the supervised learning problem for the canonical ensemble being used as a training data set. We show that just one free parameter is capable enough to describe the data-driven emergence of the universal finite-size-scaling function in the network output that is observed in a large neural network, theoretically validating its critical point prediction for unseen test data from different underlying lattices yet in the same universality class of the Ising criticality. We also numerically demonstrate the interpretation with the proposed one-parameter model by providing an example of finding a critical point with the learning of the Landau mean-field free energy being applied to the real data set from the uncorrelated random scale-free graph with a large degree exponent.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/26/2017

Phase Transitions in Image Denoising via Sparsely Coding Convolutional Neural Networks

Neural networks are analogous in many ways to spin glasses, systems whic...
research
02/13/2022

A Group-Equivariant Autoencoder for Identifying Spontaneously Broken Symmetries in the Ising Model

We introduce the group-equivariant autoencoder (GE-autoencoder) – a nove...
research
10/26/2022

Grokking phase transitions in learning local rules with gradient descent

We discuss two solvable grokking (generalisation beyond overfitting) mod...
research
07/05/2023

Absorbing Phase Transitions in Artificial Deep Neural Networks

Theoretical understanding of the behavior of infinitely-wide neural netw...
research
12/06/2020

Fourier-domain Variational Formulation and Its Well-posedness for Supervised Learning

A supervised learning problem is to find a function in a hypothesis func...
research
06/13/2012

Critical behavior in a cross-situational lexicon learning scenario

The associationist account for early word-learning is based on the co-oc...
research
12/31/2021

Transfer learning of phase transitions in percolation and directed percolation

The latest advances of statistical physics have shown remarkable perform...

Please sign up or login with your details

Forgot password? Click here to reset