Proactive Optimization with Unsupervised Learning

by   Jiajun Wu, et al.

Proactive resource allocation, say proactive caching at wireless edge, has shown promising gain in boosting network performance and improving user experience, by leveraging big data and machine learning. Earlier research efforts focus on optimizing proactive policies under the assumption that the future knowledge required for optimization is perfectly known. Recently, various machine learning techniques are proposed to predict the required knowledge such as file popularity, which is treated as the true value for the optimization. In this paper, we introduce a proactive optimization framework for optimizing proactive resource allocation, where the future knowledge is implicitly predicted from historical observations by the optimization. To this end, we formulate a proactive optimization problem by taking proactive caching and bandwidth allocation as an example, where the objective function is the conditional expectation of successful offloading probability taken over the unknown popularity given the historically observed popularity. To solve such a problem that depends on the conditional distribution of future information given current and past information, we transform the problem equivalently to a problem depending on the joint distribution of future and historical popularity. Then, we resort to stochastic optimization to learn the joint distribution and resort to unsupervised learning with neural networks to learn the optimal policy. The neural networks can be trained off-line, or in an on-line manner to adapt to the dynamic environment. Simulation results using a real dataset validate that the proposed framework can indeed predict the file popularity implicitly by optimization.


Optimal Caching Designs for Perfect, Imperfect and Unknown File Popularity Distributions in Large-Scale Multi-Tier Wireless Networks

Most existing caching solutions for wireless networks rest on an unreali...

Optimizing Wireless Systems Using Unsupervised and Reinforced-Unsupervised Deep Learning

Resource allocation and transceivers in wireless networks are usually de...

Liquid State Machine Learning for Resource and Cache Management in LTE-U Unmanned Aerial Vehicle (UAV) Networks

In this paper, the problem of joint caching and resource allocation is i...

Dynamic Multi-time Scale User Admission and Resource Allocation for Semantic Extraction in MEC Systems

This paper investigates the semantic extraction task-oriented dynamic mu...

Unsupervised Learning for Asynchronous Resource Allocation in Ad-hoc Wireless Networks

We consider optimal resource allocation problems under asynchronous wire...

Optimizing Ultra-Reliable and Low-Latency Communication Systems with Unsupervised Learning

Supervised learning has been introduced to wireless communications to so...

Please sign up or login with your details

Forgot password? Click here to reset