Anaconda: A Non-Adaptive Conditional Sampling Algorithm for Distribution Testing

07/17/2018
by   Gautam Kamath, et al.
0

We investigate distribution testing with access to non-adaptive conditional samples. In the conditional sampling model, the algorithm is given the following access to a distribution: it submits a query set S to an oracle, which returns a sample from the distribution conditioned on being from S. In the non-adaptive setting, all query sets must be specified in advance of viewing the outcomes. Our main result is the first polylogarithmic-query algorithm for equivalence testing, deciding whether two unknown distributions are equal to or far from each other. This is an exponential improvement over the previous best upper bound, and demonstrates that the complexity of the problem in this model is intermediate to the the complexity of the problem in the standard sampling model and the adaptive conditional sampling model. We also significantly improve the sample complexity for the easier problems of uniformity and identity testing. For the former, our algorithm requires only Õ( n) queries, matching the information-theoretic lower bound up to a O( n)-factor. Our algorithm works by reducing the problem from ℓ_1-testing to ℓ_∞-testing, which enjoys a much cheaper sample complexity. Necessitated by the limited power of the non-adaptive model, our algorithm is very simple to state. However, there are significant challenges in the analysis, due to the complex structure of how two arbitrary distributions may differ.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/13/2018

Distribution-free Junta Testing

We study the problem of testing whether an unknown n-variable Boolean fu...
research
08/22/2023

Tight Lower Bound on Equivalence Testing in Conditional Sampling Model

We study the equivalence testing problem where the goal is to determine ...
research
07/19/2022

Identity Testing for High-Dimensional Distributions via Entropy Tensorization

We present improved algorithms and matching statistical and computationa...
research
06/02/2022

A Scalable Shannon Entropy Estimator

We revisit the well-studied problem of estimating the Shannon entropy of...
research
09/06/2012

The Sample Complexity of Search over Multiple Populations

This paper studies the sample complexity of searching over multiple popu...
research
01/13/2023

Non-Stochastic CDF Estimation Using Threshold Queries

Estimating the empirical distribution of a scalar-valued data set is a b...
research
07/15/2016

Learning from Conditional Distributions via Dual Embeddings

Many machine learning tasks, such as learning with invariance and policy...

Please sign up or login with your details

Forgot password? Click here to reset