Estimation of Monotone Multi-Index Models

06/04/2020

∙

by   David Gamarnik, et al.

∙

0

∙

share

In a multi-index model with k index vectors, the input variables are transformed by taking inner products with the index vectors. A transfer function f: ℝ^k →ℝ is applied to these inner products to generate the output. Thus, multi-index models are a generalization of linear models. In this paper, we consider monotone multi-index models. Namely, the transfer function is assumed to be coordinate-wise monotone. The monotone multi-index model therefore generalizes both linear regression and isotonic regression, which is the estimation of a coordinate-wise monotone function. We consider the case of nonnegative index vectors. We provide an algorithm based on integer programming for the estimation of monotone multi-index models, and provide guarantees on the L_2 loss of the estimated function relative to the ground truth.