Improving Deterministic Uncertainty Estimation in Deep Learning for Classification and Regression

02/22/2021
by   Joost van Amersfoort, et al.
0

We propose a new model that estimates uncertainty in a single forward pass and works on both classification and regression problems. Our approach combines a bi-Lipschitz feature extractor with an inducing point approximate Gaussian process, offering robust and principled uncertainty estimation. This can be seen as a refinement of Deep Kernel Learning (DKL), with our changes allowing DKL to match softmax neural networks accuracy. Our method overcomes the limitations of previous work addressing deterministic uncertainty quantification, such as the dependence of uncertainty on ad hoc hyper-parameters. Our method matches SotA accuracy, 96.2 maintaining the speed of softmax models, and provides uncertainty estimates that outperform previous single forward pass uncertainty models. Finally, we demonstrate our method on a recently introduced benchmark for uncertainty in regression: treatment deferral in causal models for personalized medicine.

READ FULL TEXT

page 3

page 6

research
08/21/2023

Deep Evidential Learning for Bayesian Quantile Regression

It is desirable to have accurate uncertainty estimation from a single de...
research
03/04/2020

Simple and Scalable Epistemic Uncertainty Estimation Using a Single Deep Deterministic Neural Network

We propose a method for training a deterministic deep model that can fin...
research
05/01/2022

A Simple Approach to Improve Single-Model Deep Uncertainty via Distance-Awareness

Accurate uncertainty quantification is a major challenge in deep learnin...
research
07/29/2020

Hybrid Deep Learning Gaussian Process for Diabetic Retinopathy Diagnosis and Uncertainty Quantification

Diabetic Retinopathy (DR) is one of the microvascular complications of D...
research
03/10/2023

Training, Architecture, and Prior for Deterministic Uncertainty Methods

Accurate and efficient uncertainty estimation is crucial to build reliab...
research
10/06/2021

A Survey on Evidential Deep Learning For Single-Pass Uncertainty Estimation

Popular approaches for quantifying predictive uncertainty in deep neural...
research
11/23/2021

Uncertainty estimation under model misspecification in neural network regression

Although neural networks are powerful function approximators, the underl...

Please sign up or login with your details

Forgot password? Click here to reset