Dockerization Impacts in Database Performance Benchmarking

by   Martin Grambow, et al.

Docker seems to be an attractive solution for cloud database benchmarking as it simplifies the setup process through pre-built images that are portable and simple to maintain. However, the usage of Docker for benchmarking is only valid if there is no effect on measurement results. Existing work has so far only focused on the performance overheads that Docker directly induces for specific applications. In this paper, we have studied indirect effects of dockerization on the results of database benchmarking. Among others, our results clearly show that containerization has a measurable and non-constant influence on measurement results and should, hence, only be used after careful analysis.


page 1

page 2

page 3

page 4


Tell-Tale Tail Latencies: Pitfalls and Perils in Database Benchmarking

The performance of database systems is usually characterised by their av...

OR-Benchmark: An Open and Reconfigurable Digital Watermarking Benchmarking Framework

Benchmarking digital watermarking algorithms is not an easy task because...

WURBench: Toward Benchmarking Wake-up Radio-based Systems

The performance of wake-up radios must be clearly measured and understoo...

Benchmarking database performance for genomic data

Genomic regions represent features such as gene annotations, transcripti...

Towards a Security-Aware Benchmarking Framework for Function-as-a-Service

In a world, where complexity increases on a daily basis the Function-as-...

Benchmarking in Optimization: Best Practice and Open Issues

This survey compiles ideas and recommendations from more than a dozen re...

TELeR: A General Taxonomy of LLM Prompts for Benchmarking Complex Tasks

While LLMs have shown great success in understanding and generating text...

Please sign up or login with your details

Forgot password? Click here to reset