At the Interface of Algebra and Statistics

by   Tai-Danae Bradley, et al.

This thesis takes inspiration from quantum physics to investigate mathematical structure that lies at the interface of algebra and statistics. The starting point is a passage from classical probability theory to quantum probability theory. The quantum version of a probability distribution is a density operator, the quantum version of marginalizing is an operation called the partial trace, and the quantum version of a marginal probability distribution is a reduced density operator. Every joint probability distribution on a finite set can be modeled as a rank one density operator. By applying the partial trace, we obtain reduced density operators whose diagonals recover classical marginal probabilities. In general, these reduced densities will have rank higher than one, and their eigenvalues and eigenvectors will contain extra information that encodes subsystem interactions governed by statistics. We decode this information, and show it is akin to conditional probability, and then investigate the extent to which the eigenvectors capture "concepts" inherent in the original joint distribution. The theory is then illustrated with an experiment that exploits these ideas. Turning to a more theoretical application, we also discuss a preliminary framework for modeling entailment and concept hierarchy in natural language, namely, by representing expressions in the language as densities. Finally, initial inspiration for this thesis comes from formal concept analysis, which finds many striking parallels with the linear algebra. The parallels are not coincidental, and a common blueprint is found in category theory. We close with an exposition on free (co)completions and how the free-forgetful adjunctions in which they arise strongly suggest that in certain categorical contexts, the "fixed points" of a morphism with its adjoint encode interesting information.


page 1

page 2

page 3

page 4


Language Modeling with Reduced Densities

We present a framework for modeling words, phrases, and longer expressio...

Modeling Sequences with Quantum States: A Look Under the Hood

Classical probability distributions on sets of sequences can be modeled ...

Quantum and Classical Information Theory with Disentropy

In the present work, some concepts of quantum and classical information ...

Rapid and deterministic estimation of probability densities using scale-free field theories

The question of how best to estimate a continuous probability density fr...

Effectuses in Categorical Quantum Foundations

This thesis develops the theory of effectuses as a categorical axiomatic...

Positive-definite parametrization of mixed quantum states with deep neural networks

We introduce the Gram-Hadamard Density Operator (GHDO), a new deep neura...

Visualizing and comparing distributions with half-disk density strips

We propose a user-friendly graphical tool, the half-disk density strip (...

Please sign up or login with your details

Forgot password? Click here to reset