A Category-theoretical Meta-analysis of Definitions of Disentanglement

by   Yivan Zhang, et al.

Disentangling the factors of variation in data is a fundamental concept in machine learning and has been studied in various ways by different researchers, leading to a multitude of definitions. Despite the numerous empirical studies, more theoretical research is needed to fully understand the defining properties of disentanglement and how different definitions relate to each other. This paper presents a meta-analysis of existing definitions of disentanglement, using category theory as a unifying and rigorous framework. We propose that the concepts of the cartesian and monoidal products should serve as the core of disentanglement. With these core concepts, we show the similarities and crucial differences in dealing with (i) functions, (ii) equivariant maps, (iii) relations, and (iv) stochastic maps. Overall, our meta-analysis deepens our understanding of disentanglement and its various formulations and can help researchers navigate different definitions and choose the most appropriate one for their specific context.


page 1

page 2

page 3

page 4


Category Theory in Machine Learning

Over the past two decades machine learning has permeated almost every re...

Enriching Disentanglement: Definitions to Metrics

Disentangled representation learning is a challenging task that involves...

Phases of methodological research in biostatistics - building the evidence base for new methods

Although the biostatistical scientific literature publishes new methods ...

A taxonomy of surprise definitions

Surprising events trigger measurable brain activity and influence human ...

Computer Viruses: The Abstract Theory Revisited

Identifying new viral threats, and developing long term defences against...

Quantifying Theory in Politics: Identification, Interpretation and the Role of Structural Methods

The best empirical research in political science clearly defines substan...

La representación de la variación contextual mediante definiciones terminológicas flexibles

In this doctoral thesis, we apply premises of cognitive linguistics to t...

Please sign up or login with your details

Forgot password? Click here to reset