Uncertainty Quantification Using Neural Networks for Molecular Property Prediction

05/20/2020
by   Lior Hirschfeld, et al.
25

Uncertainty quantification (UQ) is an important component of molecular property prediction, particularly for drug discovery applications where model predictions direct experimental design and where unanticipated imprecision wastes valuable time and resources. The need for UQ is especially acute for neural models, which are becoming increasingly standard yet are challenging to interpret. While several approaches to UQ have been proposed in the literature, there is no clear consensus on the comparative performance of these models. In this paper, we study this question in the context of regression tasks. We systematically evaluate several methods on five benchmark datasets using multiple complementary performance metrics. Our experiments show that none of the methods we tested is unequivocally superior to all others, and none produces a particularly reliable ranking of errors across multiple datasets. While we believe these results show that existing UQ methods are not sufficient for all common use-cases and demonstrate the benefits of further research, we conclude with a practical recommendation as to which existing techniques seem to perform well relative to others.

READ FULL TEXT

page 5

page 18

page 25

page 40

research
07/19/2023

Uncertainty Quantification for Molecular Property Predictions with Graph Neural Architecture Search

Graph Neural Networks (GNNs) have emerged as a prominent class of data-d...
research
06/26/2020

A Comparison of Uncertainty Estimation Approaches in Deep Learning Components for Autonomous Vehicle Applications

A key to ensuring safety in Autonomous Vehicles (AVs) is to avoid any ab...
research
03/20/2019

Uncertainty quantification of molecular property prediction with Bayesian neural networks

Deep neural networks have outperformed existing machine learning models ...
research
04/22/2020

Deeply Uncertain: Comparing Methods of Uncertainty Quantification in Deep Learning Algorithms

We present a comparison of methods for uncertainty quantification (UQ) i...
research
07/18/2023

PAC Neural Prediction Set Learning to Quantify the Uncertainty of Generative Language Models

Uncertainty learning and quantification of models are crucial tasks to e...
research
07/11/2023

Predicting small molecules solubilities on endpoint devices using deep ensemble neural networks

Aqueous solubility is a valuable yet challenging property to predict. Co...
research
03/06/2021

A Statistical Perspective on the Challenges in Molecular Microbial Biology

High throughput sequencing (HTS)-based technology enables identifying an...

Please sign up or login with your details

Forgot password? Click here to reset