Evaluating Bayesian Deep Learning Methods for Semantic Segmentation

by   Jishnu Mukhoti, et al.
University of Oxford

Deep learning has been revolutionary for computer vision and semantic segmentation in particular, with Bayesian Deep Learning (BDL) used to obtain uncertainty maps from deep models when predicting semantic classes. This information is critical when using semantic segmentation for autonomous driving for example. Standard semantic segmentation systems have well-established evaluation metrics. However, with BDL's rising popularity in computer vision we require new metrics to evaluate whether a BDL method produces better uncertainty estimates than another method. In this work we propose three such metrics to evaluate BDL models designed specifically for the task of semantic segmentation. We modify DeepLab-v3+, one of the state-of-the-art deep neural networks, and create its Bayesian counterpart using MC dropout and Concrete dropout as inference techniques. We then compare and test these two inference techniques on the well-known Cityscapes dataset using our suggested metrics. Our results provide new benchmarks for researchers to compare and evaluate their improved uncertainty quantification in pursuit of safer semantic segmentation.


page 2

page 8


Evaluating Uncertainty Estimation Methods on 3D Semantic Segmentation of Point Clouds

Deep learning models are extensively used in various safety critical app...

A Review on Deep Learning Techniques Applied to Semantic Segmentation

Image semantic segmentation is more and more being of interest for compu...

Neither Quick Nor Proper -- Evaluation of QuickProp for Learning Deep Neural Networks

Neural networks and especially convolutional neural networks are of grea...

Model Stitching and Visualization How GAN Generators can Invert Networks in Real-Time

Critical applications, such as in the medical field, require the rapid p...

Probabilistic Deep Learning for Instance Segmentation

Probabilistic convolutional neural networks, which predict distributions...

Learnable Bernoulli Dropout for Bayesian Deep Learning

In this work, we propose learnable Bernoulli dropout (LBD), a new model-...

Code Repositories


Code to accompany the paper 'Improving model calibration with accuracy versus uncertainty optimization'.

view repo

Please sign up or login with your details

Forgot password? Click here to reset