Set Prediction without Imposing Structure as Conditional Density Estimation

by   David W. Zhang, et al.

Set prediction is about learning to predict a collection of unordered variables with unknown interrelations. Training such models with set losses imposes the structure of a metric space over sets. We focus on stochastic and underdefined cases, where an incorrectly chosen loss function leads to implausible predictions. Example tasks include conditional point-cloud reconstruction and predicting future states of molecules. In this paper, we propose an alternative to training via set losses by viewing learning as conditional density estimation. Our learning framework fits deep energy-based models and approximates the intractable likelihood with gradient-guided sampling. Furthermore, we propose a stochastically augmented prediction algorithm that enables multiple predictions, reflecting the possible variations in the target set. We empirically demonstrate on a variety of datasets the capability to learn multi-modal densities and produce multiple plausible predictions. Our approach is competitive with previous set prediction models on standard benchmarks. More importantly, it extends the family of addressable tasks beyond those that have unambiguous predictions.


page 8

page 15


Conditional Density Estimation via Weighted Logistic Regressions

Compared to the conditional mean as a simple point estimator, the condit...

Arbitrary Conditional Distributions with Energy

Modeling distributions of covariates, or density estimation, is a core c...

Kernel Conditional Density Operators

We introduce a conditional density estimation model termed the condition...

Fast Nonparametric Conditional Density Estimation

Conditional density estimation generalizes regression by modeling a full...

C-Learning: Learning to Achieve Goals via Recursive Classification

We study the problem of predicting and controlling the future state dist...

Neural Inverse Transform Sampler

Any explicit functional representation f of a density is hampered by two...

Video Prediction via Example Guidance

In video prediction tasks, one major challenge is to capture the multi-m...

Please sign up or login with your details

Forgot password? Click here to reset