OCAtari: Object-Centric Atari 2600 Reinforcement Learning Environments

06/14/2023
by   Quentin Delfosse, et al.
12

Cognitive science and psychology suggest that object-centric representations of complex scenes are a promising step towards enabling efficient abstract reasoning from low-level perceptual features. Yet, most deep reinforcement learning approaches rely on only pixel-based representations that do not capture the compositional properties of natural scenes. For this, we need environments and datasets that allow us to work and evaluate object-centric approaches. We present OCAtari, a set of environment that provides object-centric state representations of Atari games, the most-used evaluation framework for deep RL approaches. OCAtari also allows for RAM state manipulations of the games to change and create specific or even novel situations. The code base for this work is available at github.com/k4ntz/OC_Atari.

READ FULL TEXT

page 14

page 15

page 16

page 17

page 18

page 20

page 21

page 24

research
10/11/2022

Robust and Controllable Object-Centric Learning through Energy-based Models

Humans are remarkably good at understanding and reasoning about complex ...
research
07/19/2021

Structured World Belief for Reinforcement Learning in POMDP

Object-centric world models provide structured representation of the sce...
research
12/15/2021

Feature-Attending Recurrent Modules for Generalization in Reinforcement Learning

Deep reinforcement learning (Deep RL) has recently seen significant prog...
research
03/03/2020

Self-Supervised Object-Level Deep Reinforcement Learning

Current deep reinforcement learning approaches incorporate minimal prior...
research
08/28/2023

RobustCLEVR: A Benchmark and Framework for Evaluating Robustness in Object-centric Learning

Object-centric representation learning offers the potential to overcome ...
research
02/16/2023

Object-centric Learning with Cyclic Walks between Parts and Whole

Learning object-centric representations from complex natural environment...
research
01/27/2023

SNeRL: Semantic-aware Neural Radiance Fields for Reinforcement Learning

As previous representations for reinforcement learning cannot effectivel...

Please sign up or login with your details

Forgot password? Click here to reset