Stability and Generalization of Differentially Private Minimax Problems

04/11/2022
by   Yilin Kang, et al.
0

In the field of machine learning, many problems can be formulated as the minimax problem, including reinforcement learning, generative adversarial networks, to just name a few. So the minimax problem has attracted a huge amount of attentions from researchers in recent decades. However, there is relatively little work on studying the privacy of the general minimax paradigm. In this paper, we focus on the privacy of the general minimax setting, combining differential privacy together with minimax optimization paradigm. Besides, via algorithmic stability theory, we theoretically analyze the high probability generalization performance of the differentially private minimax algorithm under the strongly-convex-strongly-concave condition. To the best of our knowledge, this is the first time to analyze the generalization performance of general minimax paradigm, taking differential privacy into account.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/02/2020

Differentially Private Generation of Small Images

We explore the training of generative adversarial networks with differen...
research
05/08/2021

Stability and Generalization of Stochastic Gradient Methods for Minimax Problems

Many machine learning problems can be formulated as minimax problems suc...
research
01/22/2022

Differentially Private SGDA for Minimax Problems

Stochastic gradient descent ascent (SGDA) and its variants have been the...
research
06/01/2022

Bring Your Own Algorithm for Optimal Differentially Private Stochastic Minimax Optimization

We study differentially private (DP) algorithms for smooth stochastic mi...
research
01/16/2023

Enforcing Privacy in Distributed Learning with Performance Guarantees

We study the privatization of distributed learning and optimization stra...
research
07/18/2020

Tighter Generalization Bounds for Iterative Differentially Private Learning Algorithms

This paper studies the relationship between generalization and privacy p...
research
10/05/2022

On the Statistical Complexity of Estimation and Testing under Privacy Constraints

Producing statistics that respect the privacy of the samples while still...

Please sign up or login with your details

Forgot password? Click here to reset