Optimal Work Extraction and the Minimum Description Length Principle

06/08/2020
by   Léo Touzo, et al.
0

We discuss work extraction from classical information engines (e.g., Szilárd) with N-particles, q partitions, and initial arbitrary non-equilibrium states. In particular, we focus on their optimal behaviour, which includes the measurement of a set of quantities Φ with a feedback protocol that extracts the maximal average amount of work. We show that the optimal non-equilibrium state to which the engine should be driven before the measurement is given by the normalised maximum-likelihood probability distribution of a statistical model that admits Φ as sufficient statistics. Furthermore, we show that the minimax universal code redundancy ℛ^* associated to this model, provides an upper bound to the work that the demon can extract on average from the cycle, in units of k_ BT. We also find that, in the limit of N large, the maximum average extracted work cannot exceed H[Φ]/2, i.e. one half times the Shannon entropy of the measurement. Our results establish a connection between optimal work extraction in stochastic thermodynamics and optimal universal data compression, providing design principles for optimal information engines. In particular, they suggest that: (i) optimal coding is thermodynamically efficient, and (ii) it is essential to drive the system into a critical state in order to achieve optimal performance.

READ FULL TEXT
research
09/18/2021

A Tighter Upper Bound of the Expansion Factor for Universal Coding of Integers and Its Code Constructions

In entropy coding, universal coding of integers (UCI) is a binary univer...
research
03/22/2020

Variations on a Demonic Theme: Szilard's Other Engines

Szilard's now-famous single-molecule engine was only the first of three ...
research
04/15/2022

Generalized Universal Coding of Integers

Universal coding of integers (UCI) is a class of variable-length code, s...
research
01/28/2014

Bayesian Properties of Normalized Maximum Likelihood and its Fast Computation

The normalized maximized likelihood (NML) provides the minimax regret so...
research
01/27/1999

Minimum Description Length Induction, Bayesianism, and Kolmogorov Complexity

The relationship between the Bayesian approach and the minimum descripti...
research
05/20/2020

Sequential Universal Modeling for Non-Binary Sequences with Constrained Distributions

Sequential probability assignment and universal compression go hand in h...
research
08/25/2020

Entropy production and thermodynamics of information under protocol constraints

We investigate bounds on the entropy production (EP) and extractable wor...

Please sign up or login with your details

Forgot password? Click here to reset