Metric mean dimension and analog compression

12/02/2018
by   Yonatan Gutman, et al.
0

Wu and Verdú developed a theory of almost lossless analog compression, where one imposes various regularity conditions on the compressor and the decompressor with the input signal being modelled by a (typically infinite-entropy) stationary stochastic process. In this work we consider all stationary stochastic processes with trajectories in a prescribed set S⊂ [0,1]^Z of (bi)infinite sequences and find uniform lower and upper bounds for certain compression rates in terms of metric mean dimension, mean box dimension and mean Rényi information dimension. An essential tool is the recent Lindenstrauss-Tsukamoto variational principle expressing metric mean dimension in terms of rate-distortion functions. We obtain also lower bounds on compression rates for a fixed stationary process in terms of the rate-distortion function and information dimension rates and study several examples. We give a new formulation of the variational principle for metric mean dimension in terms of the Rényi information dimension.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/18/2019

New Uniform Bounds for Almost Lossless Analog Compression

Wu and Verdú developed a theory of almost lossless analog compression, w...
research
01/17/2019

Double variational principle for mean dimension

We develop a variational principle between mean dimension theory and rat...
research
10/27/2020

Around the variational principle for metric mean dimension

We study variational principles for metric mean dimension. First we prov...
research
01/17/2019

Double variational principle for mean dimension with potential

This paper contributes to the mean dimension theory of dynamical systems...
research
03/09/2023

Data-dependent Generalization Bounds via Variable-Size Compressibility

In this paper, we establish novel data-dependent upper bounds on the gen...
research
12/21/2017

On the Information Dimension of Multivariate Gaussian Processes

The authors have recently defined the Rényi information dimension rate d...
research
07/13/2022

Optimal Reach Estimation and Metric Learning

We study the estimation of the reach, an ubiquitous regularity parameter...

Please sign up or login with your details

Forgot password? Click here to reset