IRNet: A General Purpose Deep Residual Regression Framework for Materials Discovery

by   Dipendra Jha, et al.

Materials discovery is crucial for making scientific advances in many domains. Collections of data from experiments and first-principle computations have spurred interest in applying machine learning methods to create predictive models capable of mapping from composition and crystal structures to materials properties. Generally, these are regression problems with the input being a 1D vector composed of numerical attributes representing the material composition and/or crystal structure. While neural networks consisting of fully connected layers have been applied to such problems, their performance often suffers from the vanishing gradient problem when network depth is increased. In this paper, we study and propose design principles for building deep regression networks composed of fully connected layers with numerical vectors as input. We introduce a novel deep regression network with individual residual learning, IRNet, that places shortcut connections after each layer so that each layer learns the residual mapping between its output and input. We use the problem of learning properties of inorganic materials from numerical attributes derived from material composition and/or crystal structure to compare IRNet's performance against that of other machine learning techniques. Using multiple datasets from the Open Quantum Materials Database (OQMD) and Materials Project for training and evaluation, we show that IRNet provides significantly better prediction performance than the state-of-the-art machine learning approaches currently used by domain scientists. We also show that IRNet's use of individual residual learning leads to better convergence during the training phase than when shortcut connections are between multi-layer stacks while maintaining the same number of parameters.


page 1

page 2

page 3

page 4


Machine Learning based prediction of noncentrosymmetric crystal materials

Noncentrosymmetric materials play a critical role in many important appl...

Materials Representation and Transfer Learning for Multi-Property Prediction

The adoption of machine learning in materials science has rapidly transf...

EBSD Grain Knowledge Graph Representation Learning for Material Structure-Property Prediction

The microstructure is an essential part of materials, storing the genes ...

Reliable and Explainable Machine Learning Methods for Accelerated Material Discovery

Material scientists are increasingly adopting the use of machine learnin...

MatSciML: A Broad, Multi-Task Benchmark for Solid-State Materials Modeling

We propose MatSci ML, a novel benchmark for modeling MATerials SCIence u...

Predicting materials properties without crystal structure: Deep representation learning from stoichiometry

Machine learning can accelerate materials discovery by accurately predic...

Measuring the Similarity between Materials with an Emphasis on the Materials Distinctiveness

In this study, we establish a basis for selecting similarity measures wh...

Please sign up or login with your details

Forgot password? Click here to reset