Efficient Reachability Analysis of Closed-Loop Systems with Neural Network Controllers

01/05/2021
by   Michael Everett, et al.
0

Neural Networks (NNs) can provide major empirical performance improvements for robotic systems, but they also introduce challenges in formally analyzing those systems' safety properties. In particular, this work focuses on estimating the forward reachable set of closed-loop systems with NN controllers. Recent work provides bounds on these reachable sets, yet the computationally efficient approaches provide overly conservative bounds (thus cannot be used to verify useful properties), whereas tighter methods are too intensive for online computation. This work bridges the gap by formulating a convex optimization problem for reachability analysis for closed-loop systems with NN controllers. While the solutions are less tight than prior semidefinite program-based methods, they are substantially faster to compute, and some of the available computation time can be used to refine the bounds through input set partitioning, which more than overcomes the tightness gap. The proposed framework further considers systems with measurement and process noise, thus being applicable to realistic systems with uncertainty. Finally, numerical comparisons show 10× reduction in conservatism in 1/2 of the computation time compared to the state-of-the-art, and the ability to handle various sources of uncertainty is highlighted on a quadrotor model.

READ FULL TEXT
research
08/09/2021

Reachability Analysis of Neural Feedback Loops

Neural Networks (NNs) can provide major empirical performance improvemen...
research
10/01/2020

Robustness Analysis of Neural Networks via Efficient Partitioning: Theory and Applications in Control Systems

Neural networks (NNs) are now routinely implemented on systems that must...
research
11/01/2022

ReachLipBnB: A branch-and-bound method for reachability analysis of neural autonomous systems using Lipschitz bounds

We propose a novel Branch-and-Bound method for reachability analysis of ...
research
06/22/2021

Failing with Grace: Learning Neural Network Controllers that are Boundedly Unsafe

In this work, we consider the problem of learning a feed-forward neural ...
research
12/16/2021

Distributed neural network control with dependability guarantees: a compositional port-Hamiltonian approach

Large-scale cyber-physical systems require that control policies are dis...
research
11/04/2022

Discovering Closed-Loop Failures of Vision-Based Controllers via Reachability Analysis

Machine learning driven image-based controllers allow robotic systems to...
research
12/09/2022

DRIP: Domain Refinement Iteration with Polytopes for Backward Reachability Analysis of Neural Feedback Loops

Safety certification of data-driven control techniques remains a major o...

Please sign up or login with your details

Forgot password? Click here to reset