Entropy and Compression: A simple proof of an inequality of Khinchin

07/10/2019

∙

by   Riccardo Aragona, et al.

∙

0

∙

share

We prove that Entropy is a lower bound for the average compression ratio of any lossless compressor by giving a simple proof of an inequality that is a slightly variation of an inequality firstly proved by A. I. Khinchin in 1953.