Federated Learning from Only Unlabeled Data with Class-Conditional-Sharing Clients

by   Nan Lu, et al.
The University of British Columbia

Supervised federated learning (FL) enables multiple clients to share the trained model without sharing their labeled data. However, potential clients might even be reluctant to label their own data, which could limit the applicability of FL in practice. In this paper, we show the possibility of unsupervised FL whose model is still a classifier for predicting class labels, if the class-prior probabilities are shifted while the class-conditional distributions are shared among the unlabeled data owned by the clients. We propose federation of unsupervised learning (FedUL), where the unlabeled data are transformed into surrogate labeled data for each of the clients, a modified model is trained by supervised FL, and the wanted model is recovered from the modified model. FedUL is a very general solution to unsupervised FL: it is compatible with many supervised FL methods, and the recovery of the wanted model can be theoretically guaranteed as if the data have been labeled. Experiments on benchmark and real-world datasets demonstrate the effectiveness of FedUL. Code is available at https://github.com/lunanbit/FedUL.


FedSEAL: Semi-Supervised Federated Learning with Self-Ensemble Learning and Negative Learning

Federated learning (FL), a popular decentralized and privacy-preserving ...

Local or Global: Selective Knowledge Assimilation for Federated Learning with Limited Labels

Many existing FL methods assume clients with fully-labeled data, while i...

FedIL: Federated Incremental Learning from Decentralized Unlabeled Data with Convergence Analysis

Most existing federated learning methods assume that clients have fully ...

Anomaly Detection through Unsupervised Federated Learning

Federated learning (FL) is proving to be one of the most promising parad...

RC-SSFL: Towards Robust and Communication-efficient Semi-supervised Federated Learning System

Federated Learning (FL) is an emerging decentralized artificial intellig...

Does Federated Learning Really Need Backpropagation?

Federated learning (FL) is a general principle for decentralized clients...

Vertical Federated Principal Component Analysis and Its Kernel Extension on Feature-wise Distributed Data

Despite enormous research interest and rapid application of federated le...

Please sign up or login with your details

Forgot password? Click here to reset