Outside the Echo Chamber: Optimizing the Performative Risk

02/17/2021
by   John Miller, et al.
0

In performative prediction, predictions guide decision-making and hence can influence the distribution of future data. To date, work on performative prediction has focused on finding performatively stable models, which are the fixed points of repeated retraining. However, stable solutions can be far from optimal when evaluated in terms of the performative risk, the loss experienced by the decision maker when deploying a model. In this paper, we shift attention beyond performative stability and focus on optimizing the performative risk directly. We identify a natural set of properties of the loss function and model-induced distribution shift under which the performative risk is convex, a property which does not follow from convexity of the loss alone. Furthermore, we develop algorithms that leverage our structural assumptions to optimize the performative risk with better sample efficiency than generic methods for derivative-free convex optimization.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/14/2023

Performative Prediction with Neural Networks

Performative prediction is a framework for learning models that influenc...
research
05/30/2023

Plug-in Performative Optimization

When predictions are performative, the choice of which predictor to depl...
research
09/02/2022

Optimizing the Performative Risk under Weak Convexity Assumptions

In performative prediction, a predictive model impacts the distribution ...
research
08/19/2021

Risk Bounds and Calibration for a Smart Predict-then-Optimize Method

The predict-then-optimize framework is fundamental in practical stochast...
research
02/07/2014

Binary Excess Risk for Smooth Convex Surrogates

In statistical learning theory, convex surrogates of the 0-1 loss are hi...
research
07/30/2021

Distribution free optimality intervals for clustering

We address the problem of validating the ouput of clustering algorithms....
research
12/13/2022

Minimax Optimal Estimation of Stability Under Distribution Shift

The performance of decision policies and prediction models often deterio...

Please sign up or login with your details

Forgot password? Click here to reset