Bayesian Optimization for Online Management in Dynamic Mobile Edge Computing

by   Jia Yan, et al.

Recent years have witnessed the emergence of mobile edge computing (MEC), on the premise of a cost-effective enhancement in the computational ability of hardware-constrained wireless devices (WDs) comprising the Internet of Things (IoT). In a general multi-server multi-user MEC system, each WD has a computational task to execute and has to select binary (off)loading decisions, along with the analog-amplitude resource allocation variables in an online manner, with the goal of minimizing the overall energy-delay cost (EDC) with dynamic system states. While past works typically rely on the explicit expression of the EDC function, the present contribution considers a practical setting, where in lieu of system state information, the EDC function is not available in analytical form, and instead only the function values at queried points are revealed. Towards tackling such a challenging online combinatorial problem with only bandit information, novel Bayesian optimization (BO) based approaches are put forth by leveraging the multi-armed bandit (MAB) framework. Per time slot, the discrete offloading decisions are first obtained via the MAB method, and the analog resource allocation variables are subsequently optimized using the BO selection rule. By exploiting both temporal and contextual information, two novel BO approaches, termed time-varying BO and contextual time-varying BO, are developed. Numerical tests validate the merits of the proposed BO approaches compared with contemporary benchmarks under different MEC network sizes.


page 1

page 2

page 3

page 4


Multi-Armed Bandit for Energy-Efficient and Delay-Sensitive Edge Computing in Dynamic Networks with Uncertainty

In the emerging edge-computing paradigm, mobile devices offload the comp...

Optimal Offloading and Resource Allocation in Mobile-Edge Computing with Inter-user Task Dependency

Mobile-edge computing (MEC) has recently emerged as a cost-effective par...

Encryption Mechanism And Resource Allocation Optimization Based On Edge Computing Environment

A method for optimizing encryption mechanism and resource allocation bas...

Multi-agent Reinforcement Learning for Resource Allocation in IoT networks with Edge Computing

To support popular Internet of Things (IoT) applications such as virtual...

Bayesian and Multi-Armed Contextual Meta-Optimization for Efficient Wireless Radio Resource Management

Optimal resource allocation in modern communication networks calls for t...

A Bandit Approach to Online Pricing for Heterogeneous Edge Resource Allocation

Edge Computing (EC) offers a superior user experience by positioning clo...

Cost-aware learning of relevant contextual variables within Bayesian optimization

Contextual Bayesian Optimization (CBO) is a powerful framework for optim...

Please sign up or login with your details

Forgot password? Click here to reset