Beyond Worst-case Analysis of Multicore Caching Strategies

11/03/2020
by   Shahin Kamali, et al.
0

Every processor with multiple cores sharing a cache needs to implement a cache-replacement algorithm. Previous work demonstrated that the competitive ratio of a large class of online algorithms, including Least-Recently-Used (LRU), grows with the length of the input. Furthermore, even offline algorithms like Furthest-In-Future, the optimal algorithm in single-core caching, cannot compete in the multicore setting. These negative results motivate a more in-depth comparison of multicore caching algorithms via alternative analysis measures. Specifically, the power of the adversary to adapt to online algorithms suggests the need for a direct comparison of online algorithms to each other. In this paper, we introduce cyclic analysis, a generalization of bijective analysis introduced by Angelopoulos and Schweitzer [JACM'13]. Cyclic analysis captures the advantages of bijective analysis while offering flexibility that makes it more useful for comparing algorithms for a variety online problems. In particular, we take the first steps beyond worst-case analysis for analysis of multicore caching algorithms. We use cyclic analysis to establish relationships between multicore caching algorithms, including the advantage of LRU over all other multicore caching algorithms in the presence of locality of reference.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/26/2018

Beyond Worst-Case Analysis

In the worst-case analysis of algorithms, the overall performance of an ...
research
11/06/2020

Optimal Online Algorithms for File-Bundle Caching and Generalization to Distributed Caching

We consider a generalization of the standard cache problem called file-b...
research
07/13/2022

Caching with Reserves

Caching is a crucial component of many computer systems, so naturally it...
research
05/28/2020

Better and Simpler Learning-Augmented Online Caching

Lykouris and Vassilvitskii (ICML 2018) introduce a model of online cachi...
research
05/04/2023

Efficient Caching with Reserves via Marking

Online caching is among the most fundamental and well-studied problems i...
research
06/28/2021

Robust Learning-Augmented Caching: An Experimental Study

Effective caching is crucial for the performance of modern-day computing...
research
06/03/2023

On Optimal Caching and Model Multiplexing for Large Model Inference

Large Language Models (LLMs) and other large foundation models have achi...

Please sign up or login with your details

Forgot password? Click here to reset