AoI and Energy Consumption Oriented Dynamic Status Updating in Caching Enabled IoT Networks

by   Chao Xu, et al.

Caching has been regarded as a promising technique to alleviate energy consumption of sensors in Internet of Things (IoT) networks by responding to users' requests with the data packets stored in the edge caching node (ECN). For real-time applications in caching enabled IoT networks, it is essential to develop dynamic status update strategies to strike a balance between the information freshness experienced by users and energy consumed by the sensor, which, however, is not well addressed. In this paper, we first depict the evolution of information freshness, in terms of age of information (AoI), at each user. Then, we formulate a dynamic status update optimization problem to minimize the expectation of a long term accumulative cost, which jointly considers the users' AoI and sensor's energy consumption. To solve this problem, a Markov Decision Process (MDP) is formulated to cast the status updating procedure, and a model-free reinforcement learning algorithm is proposed, with which the challenge brought by the unknown of the formulated MDP's dynamics can be addressed. Finally, simulations are conducted to validate the convergence of our proposed algorithm and its effectiveness compared with the zero-wait baseline policy.


page 1

page 2

page 3

page 4

page 5

page 6


Optimal Status Update for Caching Enabled IoT Networks: A Dueling Deep R-Network Approach

In the Internet of Things (IoT) networks, caching is a promising techniq...

Optimizing the Long-Term Average Reward for Continuing MDPs: A Technical Report

Recently, we have struck the balance between the information freshness, ...

Age of Information Analysis for Dynamic Spectrum Sharing

Timely information updates are critical to time-sensitive applications i...

Deep Reinforcement Learning for IoT Networks: Age of Information and Energy Cost Tradeoff

In most Internet of Things (IoT) networks, edge nodes are commonly used ...

Optimizing Information Freshness in Computing enabled IoT Networks

Internet of Things (IoT) has emerged as one of the key features of the n...

Optimal Blocklength Allocation towards Reduced Age of Information in Wireless Sensor Networks

The freshness or timeliness of data at server is a significant key perfo...

AoI-Aware Markov Decision Policies for Caching

We consider a scenario that utilizes road side units (RSUs) as distribut...

Please sign up or login with your details

Forgot password? Click here to reset