DeepAI AI Chat
Log In Sign Up

Predictive Linear-Gaussian Models of Stochastic Dynamical Systems

by   Matthew Rudary, et al.

Models of dynamical systems based on predictive state representations (PSRs) are defined strictly in terms of observable quantities, in contrast with traditional models (such as Hidden Markov Models) that use latent variables or statespace representations. In addition, PSRs have an effectively infinite memory, allowing them to model some systems that finite memory-based models cannot. Thus far, PSR models have primarily been developed for domains with discrete observations. Here, we develop the Predictive Linear-Gaussian (PLG) model, a class of PSR models for domains with continuous observations. We show that PLG models subsume Linear Dynamical System models (also called Kalman filter models or state-space models) while using fewer parameters. We also introduce an algorithm to estimate PLG parameters from data, and contrast it with standard Expectation Maximization (EM) algorithms used to estimate Kalman filter parameters. We show that our algorithm is a consistent estimation procedure and present preliminary empirical results suggesting that our algorithm outperforms EM, particularly as the model dimension increases.


page 1

page 2

page 3

page 4


System Identification for Continuous-time Linear Dynamical Systems

The problem of system identification for the Kalman filter, relying on t...

Learning Bilinear Models of Actuated Koopman Generators from Partially-Observed Trajectories

Data-driven models for nonlinear dynamical systems based on approximatin...

Predictive State Representations: A New Theory for Modeling Dynamical Systems

Modeling dynamical systems, both for control purposes and to make predic...

Spectral learning of Bernoulli linear dynamical systems models for decision-making

Latent linear dynamical systems with Bernoulli observations provide a po...

Reduced-Rank Hidden Markov Models

We introduce the Reduced-Rank Hidden Markov Model (RR-HMM), a generaliza...

Outlier-Insensitive Kalman Filtering Using NUV Priors

The Kalman filter (KF) is a widely-used algorithm for tracking the laten...

A Linear Dynamical System Model for Text

Low dimensional representations of words allow accurate NLP models to be...