Faster Differentially Private Samplers via Rényi Divergence Analysis of Discretized Langevin MCMC

10/27/2020
by   Arun Ganesh, et al.
0

Various differentially private algorithms instantiate the exponential mechanism, and require sampling from the distribution (-f) for a suitable function f. When the domain of the distribution is high-dimensional, this sampling can be computationally challenging. Using heuristic sampling schemes such as Gibbs sampling does not necessarily lead to provable privacy. When f is convex, techniques from log-concave sampling lead to polynomial-time algorithms, albeit with large polynomials. Langevin dynamics-based algorithms offer much faster alternatives under some distance measures such as statistical distance. In this work, we establish rapid convergence for these algorithms under distance measures more suitable for differential privacy. For smooth, strongly-convex f, we give the first results proving convergence in Rényi divergence. This gives us fast differentially private algorithms for such f. Our techniques and simple and generic and apply also to underdamped Langevin dynamics.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/13/2019

Differentially Private Learning of Geometric Concepts

We present differentially private efficient algorithms for learning unio...
research
11/25/2021

Efficient Mean Estimation with Pure Differential Privacy via a Sum-of-Squares Exponential Mechanism

We give the first polynomial-time algorithm to estimate the mean of a d-...
research
11/07/2021

Sampling from Log-Concave Distributions with Infinity-Distance Guarantees and Applications to Differentially Private Optimization

For a d-dimensional log-concave distribution π(θ)∝ e^-f(θ) on a polytope...
research
05/06/2015

Fast Differentially Private Matrix Factorization

Differentially private collaborative filtering is a challenging task, bo...
research
10/24/2022

Contraction of Locally Differentially Private Mechanisms

We investigate the contraction properties of locally differentially priv...
research
03/30/2020

How to Find a Point in the Convex Hull Privately

We study the question of how to compute a point in the convex hull of an...
research
10/05/2022

Differentially Private Propensity Scores for Bias Correction

In surveys, it is typically up to the individuals to decide if they want...

Please sign up or login with your details

Forgot password? Click here to reset