Distributed Online Linear Quadratic Control for Linear Time-invariant Systems

09/29/2020
by   Ting-Jui Chang, et al.
0

Classical linear quadratic (LQ) control centers around linear time-invariant (LTI) systems, where the control-state pairs introduce a quadratic cost with time-invariant parameters. Recent advancement in online optimization and control has provided novel tools to study LQ problems that are robust to time-varying cost parameters. Inspired by this line of research, we study the distributed online LQ problem for identical LTI systems. Consider a multi-agent network where each agent is modeled as an LTI system. The LTI systems are associated with decoupled, time-varying quadratic costs that are revealed sequentially. The goal of the network is to make the control sequence of all agents competitive to that of the best centralized policy in hindsight, captured by the notion of regret. We develop a distributed variant of the online LQ algorithm, which runs distributed online gradient descent with a projection to a semi-definite programming (SDP) to generate controllers. We establish a regret bound scaling as the square root of the finite time-horizon, implying that agents reach consensus as time grows. We further provide numerical experiments verifying our theoretical result.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/15/2021

Regret Analysis of Distributed Online LQR Control for Unknown LTI Systems

Online learning has recently opened avenues for rethinking classical opt...
research
04/29/2021

Stable Online Control of LTV Systems Stable Online Control of Linear Time-Varying Systems

Linear time-varying (LTV) systems are widely used for modeling real-worl...
research
07/27/2021

Linear Quadratic Regulator Design for Multi-input Systems with A Distributed Cooperative Strategy

In this paper, a cooperative Linear Quadratic Regulator (LQR) problem is...
research
07/03/2022

Distributed Online System Identification for LTI Systems Using Reverse Experience Replay

Identification of linear time-invariant (LTI) systems plays an important...
research
06/19/2018

Online Linear Quadratic Control

We study the problem of controlling linear time-invariant systems with k...
research
02/21/2023

Regret Analysis of Online LQR Control via Trajectory Prediction and Tracking: Extended Version

In this paper, we propose and analyze a new method for online linear qua...
research
09/25/2021

Reducing the LQG Cost with Minimal Communication

We study the linear quadratic Gaussian (LQG) control problem, in which t...

Please sign up or login with your details

Forgot password? Click here to reset