Comparison of Multi-response Estimation Methods

by   Raju Rimal, et al.

Prediction performance does not always reflect the estimation behaviour of a method. High error in estimation may necessarily not result in high prediction error, but can lead to an unreliable prediction if test data lie in a slightly different subspace than the training data. In addition, high estimation error often leads to unstable estimates, and consequently, the estimated effect of predictors on the response can not have a valid interpretation. Many research fields show more interest in the effect of predictor variables than actual prediction performance. This study compares some newly-developed (envelope) and well-established (PCR, PLS) estimation methods using simulated data with specifically designed properties such as Multicollinearity in the predictor variables, the correlation between multiple responses and the position of principal components corresponding to predictors that are relevant for the response. This study aims to give some insights into these methods and help the researchers to understand and use them for further study. Here we have, not surprisingly, found that no single method is superior to others, but each has its strength for some specific nature of data. In addition, the newly developed envelope method has shown impressive results in finding relevant information from data using significantly fewer components than the other methods.


page 8

page 11

page 12

page 14

page 15

page 18


Comparison of Multi-response Prediction Methods

While data science is battling to extract information from the enormous ...

Joint Likelihood-based Principal Components Regression

We propose a method for estimating principal components regressions by m...

On estimation of the effect lag of predictors and prediction in functional linear model

We propose a functional linear model to predict a response using multipl...

Parallel integrative learning for large-scale multi-response regression with incomplete outcomes

Multi-task learning is increasingly used to investigate the association ...

Sparse Partitioning: Nonlinear regression with binary or tertiary predictors, with application to association studies

This paper presents Sparse Partitioning, a Bayesian method for identifyi...

A Generative Approach to Joint Modeling of Quantitative and Qualitative Responses

In many scientific areas, data with quantitative and qualitative (QQ) re...

A Novel Dual Predictors Framework of PEE

In this paper, we propose a improved 2D-PEH based on double prediction-e...

Please sign up or login with your details

Forgot password? Click here to reset