Federated Split Learning with Only Positive Labels for resource-constrained IoT environment

by   Praveen Joshi, et al.

Distributed collaborative machine learning (DCML) is a promising method in the Internet of Things (IoT) domain for training deep learning models, as data is distributed across multiple devices. A key advantage of this approach is that it improves data privacy by removing the necessity for the centralized aggregation of raw data but also empowers IoT devices with low computational power. Among various techniques in a DCML framework, federated split learning, known as splitfed learning (SFL), is the most suitable for efficient training and testing when devices have limited computational capabilities. Nevertheless, when resource-constrained IoT devices have only positive labeled data, multiclass classification deep learning models in SFL fail to converge or provide suboptimal results. To overcome these challenges, we propose splitfed learning with positive labels (SFPL). SFPL applies a random shuffling function to the smashed data received from clients before supplying it to the server for model training. Additionally, SFPL incorporates the local batch normalization for the client-side model portion during the inference phase. Our results demonstrate that SFPL outperforms SFL: (i) by factors of 51.54 and 32.57 for ResNet-56 and ResNet-32, respectively, with the CIFAR-100 dataset, and (ii) by factors of 9.23 and 8.52 for ResNet-32 and ResNet-8, respectively, with CIFAR-10 dataset. Overall, this investigation underscores the efficacy of the proposed SFPL framework in DCML.


FedMint: Intelligent Bilateral Client Selection in Federated Learning with Newcomer IoT Devices

Federated Learning (FL) is a novel distributed privacy-preserving learni...

Federated Learning in IoT: a Survey from a Resource-Constrained Perspective

The IoT ecosystem is able to leverage vast amounts of data for intellige...

Semi-Federated Learning for Collaborative Intelligence in Massive IoT Networks

Implementing existing federated learning in massive Internet of Things (...

ESAI: Efficient Split Artificial Intelligence via Early Exiting Using Neural Architecture Search

Recently, deep neural networks have been outperforming conventional mach...

New Directions in Distributed Deep Learning: Bringing the Network at Forefront of IoT Design

In this paper, we first highlight three major challenges to large-scale ...

Evaluation and Optimization of Distributed Machine Learning Techniques for Internet of Things

Federated learning (FL) and split learning (SL) are state-of-the-art dis...

Prune2Edge: A Multi-Phase Pruning Pipelines to Deep Ensemble Learning in IIoT

Most recently, with the proliferation of IoT devices, computational node...

Please sign up or login with your details

Forgot password? Click here to reset