Quantized Estimation of Gaussian Sequence Models in Euclidean Balls

09/24/2014
by   Yuancheng Zhu, et al.
0

A central result in statistical theory is Pinsker's theorem, which characterizes the minimax rate in the normal means model of nonparametric estimation. In this paper, we present an extension to Pinsker's theorem where estimation is carried out under storage or communication constraints. In particular, we place limits on the number of bits used to encode an estimator, and analyze the excess risk in terms of this constraint, the signal size, and the noise level. We give sharp upper and lower bounds for the case of a Euclidean ball, which establishes the Pareto-optimal minimax tradeoff between storage and risk in this setting.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/25/2015

Quantized Nonparametric Estimation over Sobolev Ellipsoids

We formulate the notion of minimax estimation under storage or communica...
research
03/04/2018

Distributed Nonparametric Regression under Communication Constraints

This paper studies the problem of nonparametric estimation of a smooth f...
research
08/25/2020

Minimax estimation of norms of a probability density: I. Lower bounds

The paper deals with the problem of nonparametric estimating the L_p–nor...
research
02/07/2019

Learning Distributions from their Samples under Communication Constraints

We consider the problem of learning high-dimensional, nonparametric and ...
research
07/21/2021

Optimal Rates for Nonparametric Density Estimation under Communication Constraints

We consider density estimation for Besov spaces when each sample is quan...
research
01/24/2020

Distributed Gaussian Mean Estimation under Communication Constraints: Optimal Rates and Communication-Efficient Algorithms

We study distributed estimation of a Gaussian mean under communication c...
research
07/28/2020

A minimax framework for quantifying risk-fairness trade-off in regression

We propose a theoretical framework for the problem of learning a real-va...

Please sign up or login with your details

Forgot password? Click here to reset