LuckyMera: a Modular AI Framework for Building Hybrid NetHack Agents

by   Luigi Quarantiello, et al.

In the last few decades we have witnessed a significant development in Artificial Intelligence (AI) thanks to the availability of a variety of testbeds, mostly based on simulated environments and video games. Among those, roguelike games offer a very good trade-off in terms of complexity of the environment and computational costs, which makes them perfectly suited to test AI agents generalization capabilities. In this work, we present LuckyMera, a flexible, modular, extensible and configurable AI framework built around NetHack, a popular terminal-based, single-player roguelike video game. This library is aimed at simplifying and speeding up the development of AI agents capable of successfully playing the game and offering a high-level interface for designing game strategies. LuckyMera comes with a set of off-the-shelf symbolic and neural modules (called "skills"): these modules can be either hard-coded behaviors, or neural Reinforcement Learning approaches, with the possibility of creating compositional hybrid solutions. Additionally, LuckyMera comes with a set of utility features to save its experiences in the form of trajectories for further analysis and to use them as datasets to train neural modules, with a direct interface to the NetHack Learning Environment and MiniHack. Through an empirical evaluation we validate our skills implementation and propose a strong baseline agent that can reach state-of-the-art performances in the complete NetHack game. LuckyMera is open-source and available at


page 2

page 5

page 6

page 11


Deceptive Games

Deceptive games are games where the reward structure or other aspects of...

ToriLLE: Learning Environment for Hand-to-Hand Combat

We present Toribash Learning Environment (ToriLLE), an interface with vi...

Plotting Behind the Scenes: Towards Learnable Game Engines

Game engines are powerful tools in computer graphics. Their power comes ...

Flows: Building Blocks of Reasoning and Collaborating AI

Recent advances in artificial intelligence (AI) have produced highly cap...

Dungeon Crawl Stone Soup as an Evaluation Domain for Artificial Intelligence

Dungeon Crawl Stone Soup is a popular, single-player, free and open-sour...

Cine-AI: Generating Video Game Cutscenes in the Style of Human Directors

Cutscenes form an integral part of many video games, but their creation ...

Modular Procedural Generation for Voxel Maps

Task environments developed in Minecraft are becoming increasingly popul...

Please sign up or login with your details

Forgot password? Click here to reset