Cluster-Specific Predictions with Multi-Task Gaussian Processes

11/16/2020
by   Arthur Leroy, et al.
6

A model involving Gaussian processes (GPs) is introduced to simultaneously handle multi-task learning, clustering, and prediction for multiple functional data. This procedure acts as a model-based clustering method for functional data as well as a learning step for subsequent predictions for new tasks. The model is instantiated as a mixture of multi-task GPs with common mean processes. A variational EM algorithm is derived for dealing with the optimisation of the hyper-parameters along with the hyper-posteriors' estimation of latent variables and processes. We establish explicit formulas for integrating the mean processes and the latent clustering variables within a predictive distribution, accounting for uncertainty on both aspects. This distribution is defined as a mixture of cluster-specific GP predictions, which enhances the performances when dealing with group-structured data. The model handles irregular grid of observations and offers different hypotheses on the covariance structure for sharing additional information across tasks. The performances on both clustering and prediction tasks are assessed through various simulated scenarios and real datasets. The overall algorithm, called MagmaClust, is publicly available as an R package.

READ FULL TEXT
research
07/21/2020

MAGMA: Inference and Prediction with Multi-Task Gaussian Processes

We investigate the problem of multiple time series forecasting, with the...
research
06/22/2019

Multi-task Learning for Aggregated Data using Gaussian Processes

Aggregated data is commonplace in areas such as epidemiology and demogra...
research
09/22/2017

Ensemble Multi-task Gaussian Process Regression with Multiple Latent Processes

Multi-task/Multi-output learning seeks to exploit correlation among task...
research
08/29/2020

Modulating Scalable Gaussian Processes for Expressive Statistical Learning

For a learning task, Gaussian process (GP) is interested in learning the...
research
12/08/2020

A Bayesian Fisher-EM algorithm for discriminative Gaussian subspace clustering

High-dimensional data clustering has become and remains a challenging ta...
research
01/26/2021

Unsupervised clustering of series using dynamic programming and neural processes

Following the work of arXiv:2101.09512, we are interested in clustering ...
research
10/29/2021

Aligned Multi-Task Gaussian Process

Multi-task learning requires accurate identification of the correlations...

Please sign up or login with your details

Forgot password? Click here to reset