List-Decodable Sparse Mean Estimation

05/28/2022
by   Shiwei Zeng, et al.
0

Robust mean estimation is one of the most important problems in statistics: given a set of samples {x_1, …, x_n}⊂ℝ^d where an α fraction are drawn from some distribution D and the rest are adversarially corrupted, it aims to estimate the mean of D. A surge of recent research interest has been focusing on the list-decodable setting where α∈ (0, 1/2], and the goal is to output a finite number of estimates among which at least one approximates the target mean. In this paper, we consider that the underlying distribution is Gaussian and the target mean is k-sparse. Our main contribution is the first polynomial-time algorithm that enjoys sample complexity O(poly(k, log d)), i.e. poly-logarithmic in the dimension. One of the main algorithmic ingredients is using low-degree sparse polynomials to filter outliers, which may be of independent interest.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/10/2022

List-Decodable Sparse Mean Estimation via Difference-of-Pairs Filtering

We study the problem of list-decodable sparse mean estimation. Specifica...
research
11/20/2017

List-Decodable Robust Mean Estimation and Learning Mixtures of Spherical Gaussians

We study the problem of list-decodable Gaussian mean estimation and the ...
research
05/20/2020

List Decodable Mean Estimation in Nearly Linear Time

Learning from data in the presence of outliers is a fundamental problem ...
research
03/19/2019

How Hard Is Robust Mean Estimation?

Robust mean estimation is the problem of estimating the mean μ∈R^d of a ...
research
11/19/2020

List-Decodable Mean Estimation in Nearly-PCA Time

Traditionally, robust statistics has focused on designing estimators tol...
research
06/01/2023

Attribute-Efficient PAC Learning of Low-Degree Polynomial Threshold Functions with Nasty Noise

The concept class of low-degree polynomial threshold functions (PTFs) pl...
research
06/18/2020

List-Decodable Mean Estimation via Iterative Multi-Fitering

We study the problem of list-decodable mean estimation for bounded cova...

Please sign up or login with your details

Forgot password? Click here to reset