Movement Penalized Bayesian Optimization with Application to Wind Energy Systems

by   Shyam Sundhar Ramesh, et al.

Contextual Bayesian optimization (CBO) is a powerful framework for sequential decision-making given side information, with important applications, e.g., in wind energy systems. In this setting, the learner receives context (e.g., weather conditions) at each round, and has to choose an action (e.g., turbine parameters). Standard algorithms assume no cost for switching their decisions at every round. However, in many practical applications, there is a cost associated with such changes, which should be minimized. We introduce the episodic CBO with movement costs problem and, based on the online learning approach for metrical task systems of Coester and Lee (2019), propose a novel randomized mirror descent algorithm that makes use of Gaussian Process confidence bounds. We compare its performance with the offline optimal sequence for each episode and provide rigorous regret guarantees. We further demonstrate our approach on the important real-world application of altitude optimization for Airborne Wind Energy Systems. In the presence of substantial movement costs, our algorithm consistently outperforms standard CBO algorithms.


page 1

page 2

page 3

page 4


Revisiting Smoothed Online Learning

In this paper, we revisit the problem of smoothed online learning, in wh...

Adaptation of Engineering Wake Models using Gaussian Process Regression and High-Fidelity Simulation Data

This article investigates the optimization of yaw control inputs of a ni...

Optimal Parameter-free Online Learning with Switching Cost

Parameter-freeness in online learning refers to the adaptivity of an alg...

Beyond Online Balanced Descent: An Optimal Algorithm for Smoothed Online Optimization

We study online convex optimization in a setting where the learner seeks...

Online Optimization with Predictions and Non-convex Losses

We study online optimization in a setting where an online learner seeks ...

Bayesian optimization for modular black-box systems with switching costs

Most existing black-box optimization methods assume that all variables i...

Truncated Variance Reduction: A Unified Approach to Bayesian Optimization and Level-Set Estimation

We present a new algorithm, truncated variance reduction (TruVaR), that ...

Please sign up or login with your details

Forgot password? Click here to reset