Nonparametric Probabilistic Regression with Coarse Learners

10/28/2022
by   Brian Lucena, et al.
0

Probabilistic Regression refers to predicting a full probability density function for the target conditional on the features. We present a nonparametric approach to this problem which combines base classifiers (typically gradient boosted forests) trained on different coarsenings of the target value. By combining such classifiers and averaging the resulting densities, we are able to compute precise conditional densities with minimal assumptions on the shape or form of the density. We combine this approach with a structured cross-entropy loss function which serves to regularize and smooth the resulting densities. Prediction intervals computed from these densities are shown to have high fidelity in practice. Furthermore, examining the properties of these densities on particular observations can provide valuable insight. We demonstrate this approach on a variety of datasets and show competitive performance, particularly on larger datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

05/27/2019

Kernel Conditional Density Operators

We introduce a conditional density estimation model termed the condition...
09/26/2019

DCTD: Deep Conditional Target Densities for Accurate Regression

While deep learning-based classification is generally addressed using st...
10/29/2020

Nonparametric estimation of copulas and copula densities by orthogonal projections

In this paper we study nonparametric estimators of copulas and copula de...
11/29/2019

Learning Likelihoods with Conditional Normalizing Flows

Normalizing Flows (NFs) are able to model complicated distributions p(y)...
03/23/2020

Efficient sampling generation from explicit densities via Normalizing Flows

For many applications, such as computing the expected value of different...
10/06/2020

The Base Measure Problem and its Solution

Probabilistic programming systems generally compute with probability den...
04/09/2022

A new family of smooth copulas with arbitrarily irregular densities

Copulas are known to satisfy a number of regularity properties, and one ...

Please sign up or login with your details

Forgot password? Click here to reset