Tracking Emotions: Intrinsic Motivation Grounded on Multi-Level Prediction Error Dynamics

by   Guido Schillaci, et al.

How do cognitive agents decide what is the relevant information to learn and how goals are selected to gain this knowledge? Cognitive agents need to be motivated to perform any action. We discuss that emotions arise when differences between expected and actual rates of progress towards a goal are experienced. Therefore, the tracking of prediction error dynamics has a tight relationship with emotions. Here, we suggest that the tracking of prediction error dynamics allows an artificial agent to be intrinsically motivated to seek new experiences but constrained to those that generate reducible prediction error.We present an intrinsic motivation architecture that generates behaviors towards self-generated and dynamic goals and that regulates goal selection and the balance between exploitation and exploration through multi-level monitoring of prediction error dynamics. This new architecture modulates exploration noise and leverages computational resources according to the dynamics of the overall performance of the learning system. Additionally, it establishes a possible solution to the temporal dynamics of goal selection. The results of the experiments presented here suggest that this architecture outperforms intrinsic motivation approaches where exploratory noise and goals are fixed and a greedy strategy is applied.


Intrinsic Motivation and Episodic Memories for Robot Exploration of High-Dimensional Sensory Spaces

This work presents an architecture that generates curiosity-driven goal-...

Intrinsic Motivation in Model-based Reinforcement Learning: A Brief Review

The reinforcement learning research area contains a wide range of method...

Hierarchical Deep Reinforcement Learning: Integrating Temporal Abstraction and Intrinsic Motivation

Learning goal-directed behavior in environments with sparse feedback is ...

A Temporal Difference Reinforcement Learning Theory of Emotion: unifying emotion, cognition and adaptive behavior

Emotions are intimately tied to motivation and the adaptation of behavio...

Design for a Darwinian Brain: Part 2. Cognitive Architecture

The accumulation of adaptations in an open-ended manner during lifetime ...

Intrinsic Motivation in Object-Action-Outcome Blending Latent Space

One effective approach for equipping artificial agents with sensorimotor...

The Rational Selection of Goal Operations and the Integration ofSearch Strategies with Goal-Driven Autonomy

Intelligent physical systems as embodied cognitive systems must perform ...

Please sign up or login with your details

Forgot password? Click here to reset