Near-optimal Offline and Streaming Algorithms for Learning Non-Linear Dynamical Systems

by   Prateek Jain, et al.

We consider the setting of vector valued non-linear dynamical systems X_t+1 = ϕ(A^* X_t) + η_t, where η_t is unbiased noise and ϕ : ℝ→ℝ is a known link function that satisfies certain expansivity property. The goal is to learn A^* from a single trajectory X_1,⋯,X_T of dependent or correlated samples. While the problem is well-studied in the linear case, where ϕ is identity, with optimal error rates even for non-mixing systems, existing results in the non-linear case hold only for mixing systems. In this work, we improve existing results for learning nonlinear systems in a number of ways: a) we provide the first offline algorithm that can learn non-linear dynamical systems without the mixing assumption, b) we significantly improve upon the sample complexity of existing results for mixing systems, c) in the much harder one-pass, streaming setting we study a SGD with Reverse Experience Replay (𝖲𝖦𝖣-𝖱𝖤𝖱) method, and demonstrate that for mixing systems, it achieves the same sample complexity as our offline algorithm, d) we justify the expansivity assumption by showing that for the popular ReLU link function – a non-expansive but easy to learn link function with i.i.d. samples – any method would require exponentially many samples (with respect to dimension of X_t) from the dynamical system. We validate our results via. simulations and demonstrate that a naive application of SGD can be highly sub-optimal. Indeed, our work demonstrates that for correlated data, specialized methods designed for the dependency structure in data can significantly outperform standard SGD based methods.


page 1

page 2

page 3

page 4


Learning nonlinear dynamical systems from a single trajectory

We introduce algorithms for learning nonlinear dynamical systems of the ...

Streaming Linear System Identification with Reverse Experience Replay

We consider the problem of estimating a stochastic linear time-invariant...

Information Theoretically Optimal Sample Complexity of Learning Dynamical Directed Acyclic Graphs

In this article, the optimal sample complexity of learning the underlyin...

Learning Partially Observed Linear Dynamical Systems from Logarithmic Number of Samples

In this work, we study the problem of learning partially observed linear...

Non-asymptotic and Accurate Learning of Nonlinear Dynamical Systems

We consider the problem of learning stabilizable systems governed by non...

Exponential Reduction in Sample Complexity with Learning of Ising Model Dynamics

The usual setting for learning the structure and parameters of a graphic...

LEADS: Learning Dynamical Systems that Generalize Across Environments

When modeling dynamical systems from real-world data samples, the distri...

Please sign up or login with your details

Forgot password? Click here to reset