Learning in Factored Domains with Information-Constrained Visual Representations

03/30/2023
by   Tyler Malloy, et al.
0

Humans learn quickly even in tasks that contain complex visual information. This is due in part to the efficient formation of compressed representations of visual information, allowing for better generalization and robustness. However, compressed representations alone are insufficient for explaining the high speed of human learning. Reinforcement learning (RL) models that seek to replicate this impressive efficiency may do so through the use of factored representations of tasks. These informationally simplistic representations of tasks are similarly motivated as the use of compressed representations of visual information. Recent studies have connected biological visual perception to disentangled and compressed representations. This raises the question of how humans learn to efficiently represent visual information in a manner useful for learning tasks. In this paper we present a model of human factored representation learning based on an altered form of a β-Variational Auto-encoder used in a visual learning task. Modelling results demonstrate a trade-off in the informational complexity of model latent dimension spaces, between the speed of learning and the accuracy of reconstructions.

READ FULL TEXT
research
12/28/2022

Representation Learning in Deep RL via Discrete Information Bottleneck

Several self-supervised representation learning methods have been propos...
research
09/22/2016

Image-embodied Knowledge Representation Learning

Entity images could provide significant visual information for knowledge...
research
05/13/2023

DNN-Compressed Domain Visual Recognition with Feature Adaptation

Learning-based image compression was shown to achieve a competitive perf...
research
10/31/2022

Disentangled (Un)Controllable Features

In the context of MDPs with high-dimensional states, reinforcement learn...
research
06/11/2023

On the Efficacy of 3D Point Cloud Reinforcement Learning

Recent studies on visual reinforcement learning (visual RL) have explore...
research
05/30/2022

Temporal Latent Bottleneck: Synthesis of Fast and Slow Processing Mechanisms in Sequence Learning

Recurrent neural networks have a strong inductive bias towards learning ...
research
09/27/2021

Compressive Visual Representations

Learning effective visual representations that generalize well without h...

Please sign up or login with your details

Forgot password? Click here to reset