Recursive ℓ_1,∞ Group lasso

01/29/2011
by   Yilun Chen, et al.
0

We introduce a recursive adaptive group lasso algorithm for real-time penalized least squares prediction that produces a time sequence of optimal sparse predictor coefficient vectors. At each time index the proposed algorithm computes an exact update of the optimal ℓ_1,∞-penalized recursive least squares (RLS) predictor. Each update minimizes a convex but nondifferentiable function optimization problem. We develop an online homotopy method to reduce the computational complexity. Numerical simulations demonstrate that the proposed algorithm outperforms the ℓ_1 regularized RLS algorithm for a group sparse system identification problem and has lower implementation complexity than direct group lasso solvers.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/16/2010

Exact block-wise optimization in group lasso and sparse group lasso for linear regression

The group lasso is a penalized regression method, used in regression pro...
research
08/06/2013

The Group Lasso for Design of Experiments

We introduce an application of the group lasso to design of exper- iment...
research
06/22/2021

Efficient recursive least squares solver for rank-deficient matrices

Updating a linear least squares solution can be critical for near real-t...
research
03/28/2022

Infinite-Dimensional Sparse Learning in Linear System Identification

Regularized methods have been widely applied to system identification pr...
research
12/24/2018

Study of Robust Diffusion Recursive Least Squares Algorithms with Side Information for Networked Agents

This work develops a robust diffusion recursive least squares algorithm ...
research
05/18/2020

The Trimmed Lasso: Sparse Recovery Guarantees and Practical Optimization by the Generalized Soft-Min Penalty

We present a new approach to solve the sparse approximation or best subs...
research
09/08/2018

Computational Sufficiency, Reflection Groups, and Generalized Lasso Penalties

We study estimators with generalized lasso penalties within the computat...

Please sign up or login with your details

Forgot password? Click here to reset