Evaluating and Incentivizing Diverse Data Contributions in Collaborative Learning

by   Baihe Huang, et al.

For a federated learning model to perform well, it is crucial to have a diverse and representative dataset. However, the data contributors may only be concerned with the performance on a specific subset of the population, which may not reflect the diversity of the wider population. This creates a tension between the principal (the FL platform designer) who cares about global performance and the agents (the data collectors) who care about local performance. In this work, we formulate this tension as a game between the principal and multiple agents, and focus on the linear experiment design problem to formally study their interaction. We show that the statistical criterion used to quantify the diversity of the data, as well as the choice of the federated learning algorithm used, has a significant effect on the resulting equilibrium. We leverage this to design simple optimal federated learning mechanisms that encourage data collectors to contribute data representative of the global population, thereby maximizing global performance.


page 1

page 2

page 3

page 4


How global observation works in Federated Learning: Integrating vertical training into Horizontal Federated Learning

Federated learning (FL) has recently emerged as a transformative paradig...

Incentivizing Federated Learning

Federated Learning is an emerging distributed collaborative learning par...

Trading Data For Learning: Incentive Mechanism For On-Device Federated Learning

Federated Learning rests on the notion of training a global model distri...

Personalized Federated Learning via Maximizing Correlation with Sparse and Hierarchical Extensions

Federated Learning (FL) is a collaborative machine learning technique to...

FedFMC: Sequential Efficient Federated Learning on Non-iid Data

As a mechanism for devices to update a global model without sharing data...

Incentivize to Build: A Crowdsourcing Framework for Federated Learning

Federated learning (FL) rests on the notion of training a global model i...

Model-sharing Games: Analyzing Federated Learning Under Voluntary Participation

Federated learning is a setting where agents, each with access to their ...

Please sign up or login with your details

Forgot password? Click here to reset