Exact Inference with Approximate Computation for Differentially Private Data via Perturbations

09/26/2019
by   Ruobin Gong, et al.
0

Differential privacy protects individuals' confidential information by subjecting data summaries to probabilistic perturbation mechanisms, carefully designed to minimize undue sacrifice of statistical efficiency. When properly integrated, differentially private data are conducive to exact inference when approximate computation techniques are employed. This paper shows that approximate Bayesian computation (ABC), a practical suite of methods to simulate from approximate posterior distributions of complex Bayesian models, produces exact posterior samples when applied to differentially private perturbation data. A parallel importance sampling implementation within Monte Carlo expectation-maximization for likelihood inference is also discussed. The results illustrate a duality between approximate computation on exact data, and exact computation on approximate data. A cleverly designed inferential procedure exploits the alignment between the statistical tradeoff of privacy versus efficiency, and the computational tradeoff of approximation versus exactness, so that paying the cost of one gains the benefit of both.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/11/2018

Differentially Private Confidence Intervals for Empirical Risk Minimization

The process of data mining with differential privacy produces results th...
research
06/15/2022

Towards Verifiable Differentially-Private Polling

Analyses that fulfill differential privacy provide plausible deniability...
research
05/21/2021

Privacy Amplification Via Bernoulli Sampling

Balancing privacy and accuracy is a major challenge in designing differe...
research
10/11/2019

ABCDP: Approximate Bayesian Computation Meets Differential Privacy

We develop a novel approximate Bayesian computation (ABC) framework, ABC...
research
07/11/2023

Differentially Private Statistical Inference through β-Divergence One Posterior Sampling

Differential privacy guarantees allow the results of a statistical analy...
research
02/26/2015

Privacy for Free: Posterior Sampling and Stochastic Gradient Monte Carlo

We consider the problem of Bayesian learning on sensitive datasets and p...
research
03/22/2021

d3p – A Python Package for Differentially-Private Probabilistic Programming

We present d3p, a software package designed to help fielding runtime eff...

Please sign up or login with your details

Forgot password? Click here to reset