Performance Modeling of Data Storage Systems using Generative Models

07/05/2023
by   Abdalaziz Rashid Al-Maeeni, et al.
Higher School of Economics
0

High-precision modeling of systems is one of the main areas of industrial data analysis. Models of systems, their digital twins, are used to predict their behavior under various conditions. We have developed several models of a storage system using machine learning-based generative models. The system consists of several components: hard disk drive (HDD) and solid-state drive (SSD) storage pools with different RAID schemes and cache. Each storage component is represented by a probabilistic model that describes the probability distribution of the component performance in terms of IOPS and latency, depending on their configuration and external data load parameters. The results of the experiments demonstrate the errors of 4-10 3-16 system. The predictions show up to 0.99 Pearson correlation with Little's law, which can be used for unsupervised reliability checks of the models. In addition, we present novel data sets that can be used for benchmarking regression algorithms, conditional generative models, and uncertainty estimation methods in machine learning.

READ FULL TEXT

page 1

page 6

08/08/2023

Application-Oriented Benchmarking of Quantum Generative Learning Using QUARK

Benchmarking of quantum machine learning (QML) algorithms is challenging...
04/20/2020

Generative Models Regression

We use recently developed techniques in generative models, specifically ...
01/20/2021

Enhancing Generative Models via Quantum Correlations

Generative modeling using samples drawn from the probability distributio...
01/08/2020

Bayesian Inversion Of Generative Models For Geologic Storage Of Carbon Dioxide

Carbon capture and storage (CCS) can aid decarbonization of the atmosphe...
08/03/2018

Robust Regression for Automatic Fusion Plasma Analysis based on Generative Modeling

The first step to realize automatic experimental data analysis for fusio...
06/09/2022

Evaluating Aleatoric Uncertainty via Conditional Generative Models

Aleatoric uncertainty quantification seeks for distributional knowledge ...
07/10/2023

SSD Forensic: Evidence Generation And Forensic Research On Solid State Drives Using Trim Analysis

Traditional hard drives consisting of spinning magnetic media platters a...

Please sign up or login with your details

Forgot password? Click here to reset