DeepAI AI Chat
Log In Sign Up

Improving Deterministic Uncertainty Estimation in Deep Learning for Classification and Regression

by   Joost van Amersfoort, et al.

We propose a new model that estimates uncertainty in a single forward pass and works on both classification and regression problems. Our approach combines a bi-Lipschitz feature extractor with an inducing point approximate Gaussian process, offering robust and principled uncertainty estimation. This can be seen as a refinement of Deep Kernel Learning (DKL), with our changes allowing DKL to match softmax neural networks accuracy. Our method overcomes the limitations of previous work addressing deterministic uncertainty quantification, such as the dependence of uncertainty on ad hoc hyper-parameters. Our method matches SotA accuracy, 96.2 maintaining the speed of softmax models, and provides uncertainty estimates that outperform previous single forward pass uncertainty models. Finally, we demonstrate our method on a recently introduced benchmark for uncertainty in regression: treatment deferral in causal models for personalized medicine.


page 3

page 6


Deep Evidential Learning for Bayesian Quantile Regression

It is desirable to have accurate uncertainty estimation from a single de...

Simple and Scalable Epistemic Uncertainty Estimation Using a Single Deep Deterministic Neural Network

We propose a method for training a deterministic deep model that can fin...

A Simple Approach to Improve Single-Model Deep Uncertainty via Distance-Awareness

Accurate uncertainty quantification is a major challenge in deep learnin...

Hybrid Deep Learning Gaussian Process for Diabetic Retinopathy Diagnosis and Uncertainty Quantification

Diabetic Retinopathy (DR) is one of the microvascular complications of D...

Training, Architecture, and Prior for Deterministic Uncertainty Methods

Accurate and efficient uncertainty estimation is crucial to build reliab...

A Survey on Evidential Deep Learning For Single-Pass Uncertainty Estimation

Popular approaches for quantifying predictive uncertainty in deep neural...

Uncertainty estimation under model misspecification in neural network regression

Although neural networks are powerful function approximators, the underl...

Code Repositories