Sample Complexity Using Infinite Multiview Models

02/08/2023
by   Robert A. Vandermeulen, et al.
0

Recent works have demonstrated that the convergence rate of a nonparametric density estimator can be greatly improved by using a low-rank estimator when the target density is a convex combination of separable probability densities with Lipschitz continuous marginals, i.e. a multiview model. However, this assumption is very restrictive and it is not clear to what degree these findings can be extended to general pdfs. This work answers this question by introducing a new way of characterizing a pdf's complexity, the non-negative Lipschitz spectrum (NL-spectrum), which, unlike smoothness properties, can be used to characterize virtually any pdf. Finite sample bounds are presented that are dependent on the target density's NL-spectrum. From this dimension-independent rates of convergence are derived that characterize when an NL-spectrum allows for a fast rate of convergence.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/02/2022

Beyond Smoothness: Incorporating Low-Rank Analysis into Nonparametric Density Estimation

The construction and theoretical analysis of the most popular universall...
research
03/02/2022

Estimation of the invariant density for discretely observed diffusion processes: impact of the sampling and of the asynchronicity

We aim at estimating in a non-parametric way the density π of the statio...
research
02/14/2019

Rate-optimal nonparametric estimation for random coefficient regression models

Random coefficient regression models are a popular tool for analyzing un...
research
12/21/2017

How Well Can Generative Adversarial Networks Learn Densities: A Nonparametric View

We study in this paper the rate of convergence for learning densities un...
research
11/06/2017

Optimal rates of entropy estimation over Lipschitz balls

We consider the problem of minimax estimation of the entropy of a densit...
research
06/30/2012

Density-Difference Estimation

We address the problem of estimating the difference between two probabil...
research
04/05/2021

An algebraic estimator for large spectral density matrices

We propose a new estimator of high-dimensional spectral density matrices...

Please sign up or login with your details

Forgot password? Click here to reset