Variance function estimation in high-dimensions

05/21/2012
by   Mladen Kolar, et al.
0

We consider the high-dimensional heteroscedastic regression model, where the mean and the log variance are modeled as a linear combination of input variables. Existing literature on high-dimensional linear regres- sion models has largely ignored non-constant error variances, even though they commonly occur in a variety of applications ranging from biostatis- tics to finance. In this paper we study a class of non-convex penalized pseudolikelihood estimators for both the mean and variance parameters. We show that the Heteroscedastic Iterative Penalized Pseudolikelihood Optimizer (HIPPO) achieves the oracle property, that is, we prove that the rates of convergence are the same as if the true model was known. We demonstrate numerical properties of the procedure on a simulation study and real world data.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/11/2022

Retire: Robust Expectile Regression in High Dimensions

High-dimensional data can often display heterogeneity due to heterosceda...
research
03/04/2022

High-dimensional Censored Regression via the Penalized Tobit Likelihood

The Tobit model has long been the standard method for regression with a ...
research
11/23/2021

A Global Two-stage Algorithm for Non-convex Penalized High-dimensional Linear Regression Problems

By the asymptotic oracle property, non-convex penalties represented by m...
research
09/24/2018

An Automated Approach Towards Sparse Single-Equation Cointegration Modelling

In this paper we propose the Single-equation Penalized Error Correction ...
research
09/12/2021

High-Dimensional Quantile Regression: Convolution Smoothing and Concave Regularization

ℓ_1-penalized quantile regression is widely used for analyzing high-dime...
research
04/18/2023

High-dimensional Multi-class Classification with Presence-only Data

Classification with positive and unlabeled (PU) data frequently arises i...
research
06/22/2021

Doubly Robust Feature Selection with Mean and Variance Outlier Detection and Oracle Properties

We propose a general approach to handle data contaminations that might d...

Please sign up or login with your details

Forgot password? Click here to reset