Variational Inducing Kernels for Sparse Convolved Multiple Output Gaussian Processes

by   Mauricio A. Álvarez, et al.
The University of Manchester

Interest in multioutput kernel methods is increasing, whether under the guise of multitask learning, multisensor networks or structured output data. From the Gaussian process perspective a multioutput Mercer kernel is a covariance function over correlated output functions. One way of constructing such kernels is based on convolution processes (CP). A key problem for this approach is efficient inference. Alvarez and Lawrence (2009) recently presented a sparse approximation for CPs that enabled efficient inference. In this paper, we extend this work in two directions: we introduce the concept of variational inducing functions to handle potential non-smooth functions involved in the kernel CP construction and we consider an alternative approach to approximate inference based on variational methods, extending the work by Titsias (2009) to the multiple output case. We demonstrate our approaches on prediction of school marks, compiler performance and financial time series.


page 1

page 2

page 3

page 4


Indian Buffet process for model selection in convolved multiple-output Gaussian processes

Multi-output Gaussian processes have received increasing attention durin...

Variational Gaussian Processes with Signature Covariances

We introduce a Bayesian approach to learn from stream-valued data by usi...

Sparse Convolved Multiple Output Gaussian Processes

Recently there has been an increasing interest in methods that deal with...

Learning Nonparametric Volterra Kernels with Gaussian Processes

This paper introduces a method for the nonparametric Bayesian learning o...

Spectrum Gaussian Processes Based On Tunable Basis Functions

Spectral approximation and variational inducing learning for the Gaussia...

Bayesian Alignments of Warped Multi-Output Gaussian Processes

We present a Bayesian extension to convolution processes which defines a...

Approximate inference in related multi-output Gaussian Process Regression

In Gaussian Processes a multi-output kernel is a covariance function ove...

Please sign up or login with your details

Forgot password? Click here to reset