Shared Visual Representations of Drawing for Communication: How do different biases affect human interpretability and intent?

10/15/2021
by   Daniela Mihai, et al.
0

We present an investigation into how representational losses can affect the drawings produced by artificial agents playing a communication game. Building upon recent advances, we show that a combination of powerful pretrained encoder networks, with appropriate inductive biases, can lead to agents that draw recognisable sketches, whilst still communicating well. Further, we start to develop an approach to help automatically analyse the semantic content being conveyed by a sketch and demonstrate that current approaches to inducing perceptual biases lead to a notion of objectness being a key feature despite the agent training being self-supervised.

READ FULL TEXT

page 4

page 8

page 9

research
06/03/2021

Learning to Draw: Emergent Communication through Sketching

Evidence that visual communication preceded written language and provide...
research
01/25/2021

The emergence of visual semantics through communication games

The emergence of communication systems between agents which learn to pla...
research
12/11/2019

Biases for Emergent Communication in Multi-agent Reinforcement Learning

We study the problem of emergent communication, in which language arises...
research
06/10/2020

DisCont: Self-Supervised Visual Attribute Disentanglement using Context Vectors

Disentangling the underlying feature attributes within an image with no ...
research
11/11/2021

Catalytic Role Of Noise And Necessity Of Inductive Biases In The Emergence Of Compositional Communication

Communication is compositional if complex signals can be represented as ...
research
08/08/2019

"Conservatives Overfit, Liberals Underfit": The Social-Psychological Control of Affect and Uncertainty

The presence of artificial agents in human social networks is growing. F...

Please sign up or login with your details

Forgot password? Click here to reset