Probabilistic Control of Heterogeneous Swarms Subject to Graph Temporal Logic Specifications: A Decentralized and Scalable Approach

by   Franck Djeumou, et al.

We develop a probabilistic control algorithm, , for swarms of agents with heterogeneous dynamics and objectives, subject to high-level task specifications. The resulting algorithm not only achieves decentralized control of the swarm but also significantly improves scalability over state-of-the-art existing algorithms. Specifically, we study a setting in which the agents move along the nodes of a graph, and the high-level task specifications for the swarm are expressed in a recently-proposed language called graph temporal logic (GTL). By constraining the distribution of the swarm over the nodes of the graph, GTL can specify a wide range of properties, including safety, progress, and response. , agnostic to the number of agents comprising the swarm, controls the density distribution of the swarm in a decentralized and probabilistic manner. To this end, it synthesizes a time-varying Markov chain modeling the time evolution of the density distribution under the GTL constraints. We first identify a subset of GTL, namely reach-avoid specifications, for which we can reduce the synthesis of such a Markov chain to either linear or semi-definite programs. Then, in the general case, we formulate the synthesis of the Markov chain as a mixed-integer nonlinear program (MINLP). We exploit the structure of the problem to provide an efficient sequential mixed-integer linear programming scheme with trust regions to solve the MINLP. We empirically demonstrate that our sequential scheme is at least three orders of magnitude faster than off-the-shelf MINLP solvers and illustrate the effectiveness of in several swarm scenarios.


page 12

page 13

page 14


Decentralized State-Dependent Markov Chain Synthesis for Swarm Guidance

This paper introduces a decentralized state-dependent Markov chain synth...

A Probabilistic Guidance Approach to Swarm-to-Swarm Engagement Problem

This paper introduces a probabilistic guidance approach for the swarm-to...

Distributed Policy Synthesis of Multi-Agent Systems With Graph Temporal Logic Specifications

We study the distributed synthesis of policies for multi-agent systems t...

Footstep Planning with Encoded Linear Temporal Logic Specifications

This article presents an approach to encode Linear Temporal Logic (LTL) ...

Control Synthesis using Signal Temporal Logic Specifications with Integral and Derivative Predicates

In many applications, the integrals and derivatives of signals carry val...

STLCCP: An Efficient Convex Optimization-based Framework for Signal Temporal Logic Specifications

Signal Temporal Logic (STL) is capable of expressing a broad range of te...

Mixed-Integer Programming for Signal Temporal Logic with Fewer Binary Variables

Signal Temporal Logic (STL) provides a convenient way of encoding comple...

Please sign up or login with your details

Forgot password? Click here to reset