Collaborative Unsupervised Visual Representation Learning from Decentralized Data

by   Weiming Zhuang, et al.
SenseTime Corporation
Nanyang Technological University

Unsupervised representation learning has achieved outstanding performances using centralized data available on the Internet. However, the increasing awareness of privacy protection limits sharing of decentralized unlabeled image data that grows explosively in multiple parties (e.g., mobile phones and cameras). As such, a natural problem is how to leverage these data to learn visual representations for downstream tasks while preserving data privacy. To address this problem, we propose a novel federated unsupervised learning framework, FedU. In this framework, each party trains models from unlabeled data independently using contrastive learning with an online network and a target network. Then, a central server aggregates trained models and updates clients' models with the aggregated model. It preserves data privacy as each party only has access to its raw data. Decentralized data among multiple parties are normally non-independent and identically distributed (non-IID), leading to performance degradation. To tackle this challenge, we propose two simple but effective methods: 1) We design the communication protocol to upload only the encoders of online networks for server aggregation and update them with the aggregated encoder; 2) We introduce a new module to dynamically decide how to update predictors based on the divergence caused by non-IID. The predictor is the other component of the online network. Extensive experiments and ablations demonstrate the effectiveness and significance of FedU. It outperforms training with only one party by over 5 14


page 1

page 2

page 3

page 4


FedCoCo: A Memory Efficient Federated Self-supervised Framework for On-Device Visual Representation Learning

The ubiquity of edge devices has led to a growing amount of unlabeled da...

Fair and autonomous sharing of federate learning models in mobile Internet of Things

Federate learning can conduct machine learning as well as protect the pr...

More Generalized and Personalized Unsupervised Representation Learning In A Distributed System

Discriminative unsupervised learning methods such as contrastive learnin...

Divergence-aware Federated Self-Supervised Learning

Self-supervised learning (SSL) is capable of learning remarkable represe...

Federated Unsupervised Representation Learning

To leverage enormous unlabeled data on distributed edge devices, we form...

Decentralized Learning with Average Difference Aggregation for Proactive Online Social Care

The Internet and the Web are being increasingly used in proactive social...

Unsupervised Model Personalization while Preserving Privacy and Scalability: An Open Problem

This work investigates the task of unsupervised model personalization, a...

Please sign up or login with your details

Forgot password? Click here to reset