Probabilistic Graphical Models and Tensor Networks: A Hybrid Framework

by   Jacob Miller, et al.

We investigate a correspondence between two formalisms for discrete probabilistic modeling: probabilistic graphical models (PGMs) and tensor networks (TNs), a powerful modeling framework for simulating complex quantum systems. The graphical calculus of PGMs and TNs exhibits many similarities, with discrete undirected graphical models (UGMs) being a special case of TNs. However, more general probabilistic TN models such as Born machines (BMs) employ complex-valued hidden states to produce novel forms of correlation among the probabilities. While representing a new modeling resource for capturing structure in discrete probability distributions, this behavior also renders the direct application of standard PGM tools impossible. We aim to bridge this gap by introducing a hybrid PGM-TN formalism that integrates quantum-like correlations into PGM models in a principled manner, using the physically-motivated concept of decoherence. We first prove that applying decoherence to the entirety of a BM model converts it into a discrete UGM, and conversely, that any subgraph of a discrete UGM can be represented as a decohered BM. This method allows a broad family of probabilistic TN models to be encoded as partially decohered BMs, a fact we leverage to combine the representational strengths of both model families. We experimentally verify the performance of such hybrid models in a sequential modeling task, and identify promising uses of our method within the context of existing applications of graphical models.


page 1

page 2

page 3

page 4


flip-hoisting: Exploiting Repeated Parameters in Discrete Probabilistic Programs

Probabilistic programming is emerging as a popular and effective means o...

On Quantum Circuits for Discrete Graphical Models

Graphical models are useful tools for describing structured high-dimensi...

Duality of Graphical Models and Tensor Networks

In this article we show the duality between tensor networks and undirect...

Interpretable and Scalable Graphical Models for Complex Spatio-temporal Processes

This thesis focuses on data that has complex spatio-temporal structure a...

Latent Racial Bias – Evaluating Racism in Police Stop-and-Searches

In this paper, we introduce the latent racial bias, a metric and method ...

Learning and Inference in Hilbert Space with Quantum Graphical Models

Quantum Graphical Models (QGMs) generalize classical graphical models by...

Please sign up or login with your details

Forgot password? Click here to reset