Managing Fog Networks using Reinforcement Learning Based Load Balancing Algorithm

by   Jung-yeon Baek, et al.

The powerful paradigm of Fog computing is currently receiving major interest, as it provides the possibility to integrate virtualized servers into networks and brings cloud service closer to end devices. To support this distributed intelligent platform, Software-Defined Network (SDN) has emerged as a viable network technology in the Fog computing environment. However, uncertainties related to task demands and the different computing capacities of Fog nodes, inquire an effective load balancing algorithm. In this paper, the load balancing problem has been addressed under the constraint of achieving the minimum latency in Fog networks. To handle this problem, a reinforcement learning based decision-making process has been proposed to find the optimal offloading decision with unknown reward and transition functions. The proposed process allows Fog nodes to offload an optimal number of tasks among incoming tasks by selecting an available neighboring Fog node under their respective resource capabilities with the aim to minimize the processing time and the overall overloading probability. Compared with the traditional approaches, the proposed scheme not only simplifies the algorithmic framework without imposing any specific assumption on the network model but also guarantees convergence in polynomial time. The results show that, during average delays, the proposed reinforcement learning-based offloading method achieves significant performance improvements over the variation of service rate and traffic arrival rate. The proposed algorithm achieves 1.17 relative to random, least-queue and nearest offloading selection schemes, respectively.


Heterogeneous Task Offloading and Resource Allocations via Deep Recurrent Reinforcement Learning in Partial Observable Multi-Fog Networks

As wireless services and applications become more sophisticated and requ...

Resilience and Load Balancing in Fog Networks: A Multi-Criteria Decision Analysis Approach

The advent of Cloud Computing enabled the proliferation of IoT applicati...

Privacy-Aware Load Balancing in Fog Networks: A Reinforcement Learning Approach

In this paper, we propose a load balancing algorithm based on Reinforcem...

Learning-based decentralized offloading decision making in an adversarial environment

Vehicular fog computing (VFC) pushes the cloud computing capability to t...

Load balancing mechanisms in fog computing: A systematic review

Recently, fog computing has been introduced as a modern distributed para...

A Review of Resource Management in Fog Computing: Machine Learning Perspective

Fog computing becomes a promising technology to process user's requests ...

Green Offloading in Fog-Assisted IoT Systems: An Online Perspective Integrating Learning and Control

In fog-assisted IoT systems, it is a common practice to offload tasks fr...

Please sign up or login with your details

Forgot password? Click here to reset