A Kernel-based Consensual Regression Aggregation Method

07/01/2020
by   Sothea Has, et al.
0

In this article, we introduce a kernel-based consensual aggregation method for regression problems. We aim to flexibly combine individual regression estimators r_1 , r_2 , …, r_M using a weighted average where the weights are defined based on some kernel function. It may be seen as a kernel smoother method implemented on the predictions given by all the individual estimators instead of the original input. This kernel-based configuration asymptotically inherits the consistency property of the basic consistent estimators. Moreover, numerical experiments carried out on several simulated and real datasets confirm that the proposed method mostly outperforms or at least biases towards the best candidate estimator of the combination.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/03/2020

Monotonicity preservation properties of kernel regression estimators

Three common classes of kernel regression estimators are considered: the...
research
04/06/2022

Consensual Aggregation on Random Projected High-dimensional Features for Regression

In this paper, we present a study of a kernel-based consensual aggregati...
research
03/08/2018

Aggregation using input-output trade-off

In this paper, we introduce a new learning strategy based on a seminal i...
research
10/06/2021

Variance function estimation in regression model via aggregation procedures

In the regression problem, we consider the problem of estimating the var...
research
12/17/2019

Kernel-Based Ensemble Learning in Python

We propose a new supervised learning algorithm, for classification and r...
research
07/19/2016

Nested Kriging predictions for datasets with large number of observations

This work falls within the context of predicting the value of a real fun...
research
03/09/2015

Graphical Exponential Screening

In high dimensions we propose and analyze an aggregation estimator of th...

Please sign up or login with your details

Forgot password? Click here to reset