Disentangled Representation Learning

11/21/2022
by   Xin Wang, et al.
0

Disentangled Representation Learning (DRL) aims to learn a model capable of identifying and disentangling the underlying factors hidden in the observable data in representation form. The process of separating underlying factors of variation into variables with semantic meaning benefits in learning explainable representations of data, which imitates the meaningful understanding process of humans when observing an object or relation. As a general learning strategy, DRL has demonstrated its power in improving the model explainability, controlability, robustness, as well as generalization capacity in a wide range of scenarios such as computer vision, natural language processing, data mining etc. In this article, we comprehensively review DRL from various aspects including motivations, definitions, methodologies, evaluations, applications and model designs. We discuss works on DRL based on two well-recognized definitions, i.e., Intuitive Definition and Group Theory Definition. We further categorize the methodologies for DRL into four groups, i.e., Traditional Statistical Approaches, Variational Auto-encoder Based Approaches, Generative Adversarial Networks Based Approaches, Hierarchical Approaches and Other Approaches. We also analyze principles to design different DRL models that may benefit different tasks in practical applications. Finally, we point out challenges in DRL as well as potential research directions deserving future investigations. We believe this work may provide insights for promoting the DRL research in the community.

READ FULL TEXT
research
10/25/2020

A Comprehensive Survey on Curriculum Learning

Curriculum learning (CL) is a training strategy that trains a machine le...
research
02/17/2022

A Survey on Deep Reinforcement Learning-based Approaches for Adaptation and Generalization

Deep Reinforcement Learning (DRL) aims to create intelligent agents that...
research
08/27/2022

Unsupervised Representation Learning in Deep Reinforcement Learning: A Review

This review addresses the problem of learning abstract representations o...
research
08/26/2021

A Tutorial on Learning Disentangled Representations in the Imaging Domain

Disentangled representation learning has been proposed as an approach to...
research
05/19/2023

Enriching Disentanglement: Definitions to Metrics

Disentangled representation learning is a challenging task that involves...
research
09/21/2020

Improving Robustness and Generality of NLP Models Using Disentangled Representations

Supervised neural networks, which first map an input x to a single repre...
research
03/22/2021

Enhancing the Generalization Performance and Speed Up Training for DRL-based Mapless Navigation

Training an agent to navigate with DRL is data-hungry, which requires mi...

Please sign up or login with your details

Forgot password? Click here to reset