A sparse semismooth Newton based proximal majorization-minimization algorithm for nonconvex square-root-loss regression problems

03/27/2019
by   Peipei Tang, et al.
0

In this paper, we consider high-dimensional nonconvex square-root-loss regression problems and introduce a proximal majorization-minimization (PMM) algorithm for these problems. Our key idea for making the proposed PMM to be efficient is to develop a sparse semismooth Newton method to solve the corresponding subproblems. By using the Kurdyka-Łojasiewicz property exhibited in the underlining problems, we prove that the PMM algorithm converges to a d-stationary point. We also analyze the oracle property of the initial subproblem used in our algorithm. Extensive numerical experiments are presented to demonstrate the high efficiency of the proposed PMM algorithm.

READ FULL TEXT
research
06/25/2021

A proximal-proximal majorization-minimization algorithm for nonconvex tuning-free robust regression problems

In this paper, we introduce a proximal-proximal majorization-minimizatio...
research
11/30/2022

Newton Method with Variable Selection by the Proximal Gradient Method

In sparse estimation, in which the sum of the loss function and the regu...
research
11/27/2021

A dual semismooth Newton based augmented Lagrangian method for large-scale linearly constrained sparse group square-root Lasso problems

Square-root Lasso problems are proven robust regression problems. Furthe...
research
12/28/2021

A Correctly Rounded Newton Step for the Reciprocal Square Root

The reciprocal square root is an important computation for which many so...
research
05/01/2021

l1-Norm Minimization with Regula Falsi Type Root Finding Methods

Sparse level-set formulations allow practitioners to find the minimum 1-...
research
11/10/2019

A unified approach for projections onto the intersection of ℓ_1 and ℓ_2 balls or spheres

This paper focuses on designing a unified approach for computing the pro...
research
08/28/2017

An inexact subsampled proximal Newton-type method for large-scale machine learning

We propose a fast proximal Newton-type algorithm for minimizing regulari...

Please sign up or login with your details

Forgot password? Click here to reset