Caching Contents with Varying Popularity using Restless Bandits

10/31/2022
by   Pavamana K J, et al.
0

Mobile networks are experiencing prodigious increase in data volume and user density , which exerts a great burden on mobile core networks and backhaul links. An efficient technique to lessen this problem is to use caching i.e. to bring the data closer to the users by making use of the caches of edge network nodes, such as fixed or mobile access points and even user devices. The performance of a caching depends on contents that are cached. In this paper, we examine the problem of content caching at the wireless edge(i.e. base stations) to minimize the discounted cost incurred over infinite horizon. We formulate this problem as a restless bandit problem, which is hard to solve. We begin by showing an optimal policy is of threshold type. Using these structural results, we prove the indexability of the problem, and use Whittle index policy to minimize the discounted cost.

READ FULL TEXT
research
02/26/2022

Model-free Reinforcement Learning for Content Caching at the Wireless Edge via Restless Bandits

An explosive growth in the number of on-demand content requests has impo...
research
05/12/2021

A Survey on Reinforcement Learning-Aided Caching in Mobile Edge Networks

Mobile networks are experiencing tremendous increase in data volume and ...
research
11/28/2017

A Framework for Semantic In-network Caching and Prefetching in 5G Mobile Networks

Recent popularity of mobile devices increased the demand for mobile netw...
research
10/25/2018

A Novel Mobile Edge Network Architecture with Joint Caching-Delivering and Horizontal Cooperation

Mobile edge caching/computing has been emerging as a promising paradigm ...
research
01/09/2019

On Optimal Proactive and Retention-Aware Caching with User Mobility

Caching popular contents at edge devices is an effective solution to all...
research
07/31/2019

A rolling-horizon dynamic programming approach for collaborative caching

In this paper, we study the online collaborative content caching problem...
research
12/19/2017

A Reinforcement-Learning Approach to Proactive Caching in Wireless Networks

We consider a mobile user accessing contents in a dynamic environment, w...

Please sign up or login with your details

Forgot password? Click here to reset