Lossless preprocessing of floating point data to enhance compression

by   Francesco Taurone, et al.

Data compression algorithms typically rely on identifying repeated sequences of symbols from the original data to provide a compact representation of the same information, while maintaining the ability to recover the original data from the compressed sequence. Using data transformations prior to the compression process has the potential to enhance the compression capabilities, being lossless as long as the transformation is invertible. Floating point data presents unique challenges to generate invertible transformations with high compression potential. This paper identifies key conditions for basic operations of floating point data that guarantee lossless transformations. Then, we show four methods that make use of these observations to deliver lossless compression of real datasets, where we improve compression rates up to 40


page 1

page 2

page 3

page 4


Change a Bit to save Bytes: Compression for Floating Point Time-Series Data

The number of IoT devices is expected to continue its dramatic growth in...

IDEALEM: Statistical Similarity Based Data Reduction

Many applications such as scientific simulation, sensing, and power grid...

Erasing-based lossless compression method for streaming floating-point time series

There are a prohibitively large number of floating-point time series dat...

Inline Vector Compression for Computational Physics

A novel inline data compression method is presented for single-precision...

Criteria for the numerical constant recognition

The need for recognition/approximation of functions in terms of elementa...

Adaptive Encoding Strategies for Erasing-Based Lossless Floating-Point Compression

Lossless floating-point time series compression is crucial for a wide ra...

DSSIM: a structural similarity index for floating-point data

Data visualization is a critical component in terms of interacting with ...

Please sign up or login with your details

Forgot password? Click here to reset