Adversarial Causal Bayesian Optimization

by   Scott Sussex, et al.

In Causal Bayesian Optimization (CBO), an agent intervenes on an unknown structural causal model to maximize a downstream reward variable. In this paper, we consider the generalization where other agents or external events also intervene on the system, which is key for enabling adaptiveness to non-stationarities such as weather changes, market forces, or adversaries. We formalize this generalization of CBO as Adversarial Causal Bayesian Optimization (ACBO) and introduce the first algorithm for ACBO with bounded regret: Causal Bayesian Optimization with Multiplicative Weights (CBO-MW). Our approach combines a classical online learning strategy with causal modeling of the rewards. To achieve this, it computes optimistic counterfactual reward estimates by propagating uncertainty through the causal graph. We derive regret bounds for CBO-MW that naturally depend on graph-related quantities. We further propose a scalable implementation for the case of combinatorial interventions and submodular rewards. Empirically, CBO-MW outperforms non-causal and non-adversarial Bayesian optimization methods on synthetic environments and environments based on real-word data. Our experiments include a realistic demonstration of how CBO-MW can be used to learn users' demand patterns in a shared mobility system and reposition vehicles in strategic areas.


page 1

page 2

page 3

page 4


Model-based Causal Bayesian Optimization

How should we intervene on an unknown structural causal model to maximiz...

Causal Entropy Optimization

We study the problem of globally optimizing the causal effect on a targe...

Constrained Causal Bayesian Optimization

We propose constrained causal Bayesian optimization (cCBO), an approach ...

Causal Bayesian Optimization

This paper studies the problem of globally optimizing a variable of inte...

Functional Causal Bayesian Optimization

We propose functional causal Bayesian optimization (fCBO), a method for ...

Multi-action Offline Policy Learning with Bayesian Optimization

We study an offline multi-action policy learning algorithm based on doub...

Building Object-based Causal Programs for Human-like Generalization

We present a novel task that measures how people generalize objects' cau...

Please sign up or login with your details

Forgot password? Click here to reset