Google Research Football: A Novel Reinforcement Learning Environment

by   Karol Kurach, et al.

Recent progress in the field of reinforcement learning has been accelerated by virtual learning environments such as video games, where novel algorithms and ideas can be quickly tested in a safe and reproducible manner. We introduce the Google Research Football Environment, a new reinforcement learning environment where agents are trained to play football in an advanced, physics-based 3D simulator. The resulting environment is challenging, easy to use and customize, and it is available under a permissive open-source license. In addition, it provides support for multiplayer and multi-agent experiments. We propose three full-game scenarios of varying difficulty with the Football Benchmarks and report baseline results for three commonly used reinforcement algorithms (IMPALA, PPO, and Ape-X DQN). We also provide a diverse set of simpler scenarios with the Football Academy and showcase several promising research directions.


page 1

page 2

page 6

page 11


XRoute Environment: A Novel Reinforcement Learning Environment for Routing

Routing is a crucial and time-consuming stage in modern design automatio...

DyFEn: Agent-Based Fee Setting in Payment Channel Networks

In recent years, with the development of easy to use learning environmen...

rSoccer: A Framework for Studying Reinforcement Learning in Small and Very Small Size Robot Soccer

Reinforcement learning is an active research area with a vast number of ...

Flatland: a Lightweight First-Person 2-D Environment for Reinforcement Learning

We propose Flatland, a simple, lightweight environment for fast prototyp...

Technical Challenges of Deploying Reinforcement Learning Agents for Game Testing in AAA Games

Going from research to production, especially for large and complex soft...

Playing SNES in the Retro Learning Environment

Mastering a video game requires skill, tactics and strategy. While these...

Agents that Listen: High-Throughput Reinforcement Learning with Multiple Sensory Systems

Humans and other intelligent animals evolved highly sophisticated percep...

Code Repositories


Check out the new game server:

view repo

Please sign up or login with your details

Forgot password? Click here to reset