Scene Uncertainty and the Wellington Posterior of Deterministic Image Classifiers

06/25/2021
by   Stephanie Tsuei, et al.
4

We propose a method to estimate the uncertainty of the outcome of an image classifier on a given input datum. Deep neural networks commonly used for image classification are deterministic maps from an input image to an output class. As such, their outcome on a given datum involves no uncertainty, so we must specify what variability we are referring to when defining, measuring and interpreting "confidence." To this end, we introduce the Wellington Posterior, which is the distribution of outcomes that would have been obtained in response to data that could have been generated by the same scene that produced the given image. Since there are infinitely many scenes that could have generated the given image, the Wellington Posterior requires induction from scenes other than the one portrayed. We explore alternate methods using data augmentation, ensembling, and model linearization. Additional alternatives include generative adversarial networks, conditional prior networks, and supervised single-view reconstruction. We test these alternatives against the empirical posterior obtained by inferring the class of temporally adjacent frames in a video. These developments are only a small step towards assessing the reliability of deep network classifiers in a manner that is compatible with safety-critical applications.

READ FULL TEXT

page 14

page 16

07/13/2018

Parametric generation of conditional geological realizations using generative neural networks

We introduce a method for parametric generation of conditional geologica...
01/31/2022

UQGAN: A Unified Model for Uncertainty Quantification of Deep Classifiers trained via Conditional GANs

We present an approach to quantifying both aleatoric and epistemic uncer...
07/01/2020

Estimation with Uncertainty via Conditional Generative Adversarial Networks

Conventional predictive Artificial Neural Networks (ANNs) commonly emplo...
12/01/2022

Test-Time Mixup Augmentation for Data and Class-Specific Uncertainty Estimation in Multi-Class Image Classification

Uncertainty estimation of the trained deep learning network provides imp...
07/20/2021

A Bayesian Approach to Invariant Deep Neural Networks

We propose a novel Bayesian neural network architecture that can learn i...
01/11/2021

Explaining the Black-box Smoothly- A Counterfactual Approach

We propose a BlackBox Counterfactual Explainer that is explicitly develo...

Please sign up or login with your details

Forgot password? Click here to reset