Modern Hopfield Networks for Few- and Zero-Shot Reaction Prediction

by   Philipp Seidl, et al.

An essential step in the discovery of new drugs and materials is the synthesis of a molecule that exists so far only as an idea to test its biological and physical properties. While computer-aided design of virtual molecules has made large progress, computer-assisted synthesis planning (CASP) to realize physical molecules is still in its infancy and lacks a performance level that would enable large-scale molecule discovery. CASP supports the search for multi-step synthesis routes, which is very challenging due to high branching factors in each synthesis step and the hidden rules that govern the reactions. The central and repeatedly applied step in CASP is reaction prediction, for which machine learning methods yield the best performance. We propose a novel reaction prediction approach that uses a deep learning architecture with modern Hopfield networks (MHNs) that is optimized by contrastive learning. An MHN is an associative memory that can store and retrieve chemical reactions in each layer of a deep learning architecture. We show that our MHN contrastive learning approach enables few- and zero-shot learning for reaction prediction which, in contrast to previous methods, can deal with rare, single, or even no training example(s) for a reaction. On a well established benchmark, our MHN approach pushes the state-of-the-art performance up by a large margin as it improves the predictive top-100 accuracy from 0.858±0.004 to 0.959±0.004. This advance might pave the way to large-scale molecule discovery.


page 3

page 16


Value-Added Chemical Discovery Using Reinforcement Learning

Computer-assisted synthesis planning aims to help chemists find better r...

Models Matter: The Impact of Single-Step Retrosynthesis on Synthesis Planning

Retrosynthesis consists of breaking down a chemical compound recursively...

Partial Product Aware Machine Learning on DNA-Encoded Libraries

DNA encoded libraries (DELs) are used for rapid large-scale screening of...

MechRetro is a chemical-mechanism-driven graph learning framework for interpretable retrosynthesis prediction and pathway planning

Leveraging artificial intelligence for automatic retrosynthesis speeds u...

RLSynC: Offline-Online Reinforcement Learning for Synthon Completion

Retrosynthesis is the process of determining the set of reactant molecul...

Non-Autoregressive Electron Redistribution Modeling for Reaction Prediction

Reliably predicting the products of chemical reactions presents a fundam...

Retrosynthetic Planning with Dual Value Networks

Retrosynthesis, which aims to find a route to synthesize a target molecu...

Please sign up or login with your details

Forgot password? Click here to reset