Stochastic Control with Stale Information--Part I: Fully Observable Systems

10/25/2018
by   Touraj Soleymani, et al.
0

In this study, we adopt age of information as a measure of the staleness of information, and take initial steps towards analyzing the control performance of stochastic systems with stale information. Our goals are to cast light on a fundamental limit on the information staleness that is required for a certain level of the control performance and to specify the corresponding stalest information pattern. In the asymptotic regime, such a limit asserts a critical information staleness that is required for stabilization. We achieve these goals by formulating the problem as a stochastic optimization problem and characterizing the associated optimal solutions. These solutions are in fact a control policy, which specifies the control inputs of the plant, and a queuing policy, which specifies the staleness of information at the controller.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/18/2018

Value of Information in Feedback Control

In this article, we investigate the impact of information on networked c...
research
07/31/2019

Wireless Networked Control Systems with Coding-Free Data Transmission for Industrial IoT

Wireless networked control systems for the Industrial Internet of Things...
research
12/22/2020

Fundamental Limits on the Maximum Deviations in Control Systems: How Short Can Distribution Tails be Made by Feedback?

In this paper, we adopt an information-theoretic approach to investigate...
research
05/17/2021

Stochastic Control through Approximate Bayesian Input Inference

Optimal control under uncertainty is a prevailing challenge in control, ...
research
02/07/2010

A Minimum Relative Entropy Controller for Undiscounted Markov Decision Processes

Adaptive control problems are notoriously difficult to solve even in the...
research
05/24/2022

Learning Stabilizing Policies in Stochastic Control Systems

In this work, we address the problem of learning provably stable neural ...

Please sign up or login with your details

Forgot password? Click here to reset