Gaussian Process Based Message Filtering for Robust Multi-Agent Cooperation in the Presence of Adversarial Communication

by   Rupert Mitchell, et al.

In this paper, we consider the problem of providing robustness to adversarial communication in multi-agent systems. Specifically, we propose a solution towards robust cooperation, which enables the multi-agent system to maintain high performance in the presence of anonymous non-cooperative agents that communicate faulty, misleading or manipulative information. In pursuit of this goal, we propose a communication architecture based on Graph Neural Networks (GNNs), which is amenable to a novel Gaussian Process (GP)-based probabilistic model characterizing the mutual information between the simultaneous communications of different agents due to their physical proximity and relative position. This model allows agents to locally compute approximate posterior probabilities, or confidences, that any given one of their communication partners is being truthful. These confidences can be used as weights in a message filtering scheme, thereby suppressing the influence of suspicious communication on the receiving agent's decisions. In order to assess the efficacy of our method, we introduce a taxonomy of non-cooperative agents, which distinguishes them by the amount of information available to them. We demonstrate in two distinct experiments that our method performs well across this taxonomy, outperforming alternative methods. For all but the best informed adversaries, our filtering method is able to reduce the impact that non-cooperative agents cause, reducing it to the point of negligibility, and with negligible cost to performance in the absence of adversaries.


page 1

page 10


Learning Attentional Communication for Multi-Agent Cooperation

Communication could potentially be an effective way for multi-agent coop...

Communication-Robust Multi-Agent Learning by Adaptable Auxiliary Multi-Agent Adversary Generation

Communication can promote coordination in cooperative Multi-Agent Reinfo...

Trust-based Rate-Tunable Control Barrier Functions for Non-Cooperative Multi-Agent Systems

For efficient and robust task accomplishment in multi-agent systems, an ...

Learning Individually Inferred Communication for Multi-Agent Cooperation

Communication lays the foundation for human cooperation. It is also cruc...

Graph Convolutional Reinforcement Learning for Multi-Agent Cooperation

Learning to cooperate is crucially important in multi-agent reinforcemen...

V2X System Architecture Utilizing Hybrid Gaussian Process-based Model Structures

Scalable communication is of utmost importance for reliable disseminatio...

Establishing Shared Query Understanding in an Open Multi-Agent System

We propose a method that allows to develop shared understanding between ...

Please sign up or login with your details

Forgot password? Click here to reset