A Note on Learning Rare Events in Molecular Dynamics using LSTM and Transformer

by   Wenqi Zeng, et al.

Recurrent neural networks for language models like long short-term memory (LSTM) have been utilized as a tool for modeling and predicting long term dynamics of complex stochastic molecular systems. Recently successful examples on learning slow dynamics by LSTM are given with simulation data of low dimensional reaction coordinate. However, in this report we show that the following three key factors significantly affect the performance of language model learning, namely dimensionality of reaction coordinates, temporal resolution and state partition. When applying recurrent neural networks to molecular dynamics simulation trajectories of high dimensionality, we find that rare events corresponding to the slow dynamics might be obscured by other faster dynamics of the system, and cannot be efficiently learned. Under such conditions, we find that coarse graining the conformational space into metastable states and removing recrossing events when estimating transition probabilities between states could greatly help improve the accuracy of slow dynamics learning in molecular dynamics. Moreover, we also explore other models like Transformer, which do not show superior performance than LSTM in overcoming these issues. Therefore, to learn rare events of slow molecular dynamics by LSTM and Transformer, it is critical to choose proper temporal resolution (i.e., saving intervals of MD simulation trajectories) and state partition in high resolution data, since deep neural network models might not automatically disentangle slow dynamics from fast dynamics when both are present in data influencing each other.


page 1

page 2

page 3

page 4


Molecular Latent Space Simulators

Small integration time steps limit molecular dynamics (MD) simulations t...

Latent Time-Adaptive Drift-Diffusion Model

Animals can quickly learn the timing of events with fixed intervals and ...

Streaming Video QoE Modeling and Prediction: A Long Short-Term Memory Approach

HTTP based adaptive video streaming has become a popular choice of strea...

GraphVAMPNet, using graph neural networks and variational approach to markov processes for dynamical modeling of biomolecules

Finding low dimensional representation of data from long-timescale traje...

Supervised Learning and the Finite-Temperature String Method for Computing Committor Functions and Reaction Rates

A central object in the computational studies of rare events is the comm...

Super-resolution in Molecular Dynamics Trajectory Reconstruction with Bi-Directional Neural Networks

Molecular dynamics simulations are a cornerstone in science, allowing to...

Slow-varying Dynamics Assisted Temporal Capsule Network for Machinery Remaining Useful Life Estimation

Capsule network (CapsNet) acts as a promising alternative to the typical...

Please sign up or login with your details

Forgot password? Click here to reset