Optimal algorithms for group distributionally robust optimization and beyond

12/28/2022
by   Tasuku Soma, et al.
0

Distributionally robust optimization (DRO) can improve the robustness and fairness of learning methods. In this paper, we devise stochastic algorithms for a class of DRO problems including group DRO, subpopulation fairness, and empirical conditional value at risk (CVaR) optimization. Our new algorithms achieve faster convergence rates than existing algorithms for multiple DRO settings. We also provide a new information-theoretic lower bound that implies our bounds are tight for group DRO. Empirically, too, our algorithms outperform known methods

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/14/2020

Fast Fair Regression via Efficient Approximations of Mutual Information

Most work in algorithmic fairness to date has focused on discrete outcom...
research
02/24/2021

FERMI: Fair Empirical Risk Minimization via Exponential Rényi Mutual Information

In this paper, we propose a new notion of fairness violation, called Exp...
research
08/21/2022

Bipartite Matchings with Group Fairness and Individual Fairness Constraints

We address group as well as individual fairness constraints in matchings...
research
12/30/2020

A Maximal Correlation Approach to Imposing Fairness in Machine Learning

As machine learning algorithms grow in popularity and diversify to many ...
research
03/01/2023

Re-weighting Based Group Fairness Regularization via Classwise Robust Optimization

Many existing group fairness-aware training methods aim to achieve the g...
research
05/26/2020

Class-Weighted Classification: Trade-offs and Robust Approaches

We address imbalanced classification, the problem in which a label may h...
research
09/13/2021

On Tilted Losses in Machine Learning: Theory and Applications

Exponential tilting is a technique commonly used in fields such as stati...

Please sign up or login with your details

Forgot password? Click here to reset