The role of feature space in atomistic learning

09/06/2020
by   Alexander Goscinski, et al.
11

Efficient, physically-inspired descriptors of the structure and composition of molecules and materials play a key role in the application of machine-learning techniques to atomistic simulations. The proliferation of approaches, as well as the fact that each choice of features can lead to very different behavior depending on how they are used, e.g. by introducing non-linear kernels and non-Euclidean metrics to manipulate them, makes it difficult to objectively compare different methods, and to address fundamental questions on how one feature space is related to another. In this work we introduce a framework to compare different sets of descriptors, and different ways of transforming them by means of metrics and kernels, in terms of the structure of the feature space that they induce. We define diagnostic tools to determine whether alternative feature spaces contain equivalent amounts of information, and whether the common information is substantially distorted when going from one feature space to another. We compare, in particular, representations that are built in terms of n-body correlations of the atom density, quantitatively assessing the information loss associated with the use of low-order features. We also investigate the impact of different choices of basis functions and hyperparameters of the widely used SOAP and Behler-Parrinello features, and investigate how the use of non-linear kernels, and of a Wasserstein-type metric, change the structure of the feature space in comparison to a simpler linear feature space.

READ FULL TEXT

page 5

page 7

page 8

page 9

page 11

page 12

research
03/07/2023

Wigner kernels: body-ordered equivariant machine learning without a basis

Machine-learning models based on a point-cloud representation of a physi...
research
03/22/2022

Exploring Linear Feature Disentanglement For Neural Networks

Non-linear activation functions, e.g., Sigmoid, ReLU, and Tanh, have ach...
research
07/15/2020

Kernel Method based on Non-Linear Coherent State

In this paper, by mapping datasets to a set of non-linear coherent state...
research
05/21/2018

Kernel Pre-Training in Feature Space via m-Kernels

This paper presents a novel approach to kernel tuning. The method presen...
research
05/31/2023

F?D: On understanding the role of deep feature spaces on face generation evaluation

Perceptual metrics, like the Fréchet Inception Distance (FID), are widel...
research
12/19/2013

Continuous Learning: Engineering Super Features With Feature Algebras

In this paper we consider a problem of searching a space of predictive m...
research
02/08/2019

Classifying and analysis of random composites using structural sums feature vector

The main goal of this paper is to present the application of structural ...

Please sign up or login with your details

Forgot password? Click here to reset