Specializing Inter-Agent Communication in Heterogeneous Multi-Agent Reinforcement Learning using Agent Class Information

Inspired by recent advances in agent communication with graph neural networks, this work proposes the representation of multi-agent communication capabilities as a directed labeled heterogeneous agent graph, in which node labels denote agent classes and edge labels, the communication type between two classes of agents. We also introduce a neural network architecture that specializes communication in fully cooperative heterogeneous multi-agent tasks by learning individual transformations to the exchanged messages between each pair of agent classes. By also employing encoding and action selection modules with parameter sharing for environments with heterogeneous agents, we demonstrate comparable or superior performance in environments where a larger number of agent classes operates.

READ FULL TEXT

page 4

page 6

research
09/28/2020

Towards Heterogeneous Multi-Agent Reinforcement Learning with Graph Neural Networks

This work proposes a neural network architecture that learns policies fo...
research
06/14/2022

Universally Expressive Communication in Multi-Agent Reinforcement Learning

Allowing agents to share information through communication is crucial fo...
research
03/24/2021

ModGNN: Expert Policy Approximation in Multi-Agent Systems with a Modular Graph Neural Network Architecture

Recent work in the multi-agent domain has shown the promise of Graph Neu...
research
02/28/2023

On the Role of Emergent Communication for Social Learning in Multi-Agent Reinforcement Learning

Explicit communication among humans is key to coordinating and learning....
research
04/13/2022

Copiloting Autonomous Multi-Robot Missions: A Game-inspired Supervisory Control Interface

Real-world deployment of new technology and capabilities can be daunting...
research
10/08/2014

Committment-Based Data-Aware Multi-Agent-Contexts Systems

Communication and interaction among agents have been the subject of exte...
research
03/31/2023

Reduce, Reuse, Recycle: Selective Reincarnation in Multi-Agent Reinforcement Learning

'Reincarnation' in reinforcement learning has been proposed as a formali...

Please sign up or login with your details

Forgot password? Click here to reset