Title :
Recursive
Group Lasso
Author :
Chen, Yilun ; Hero, Alfred O.
Author_Institution :
Dept. of Electr. Eng. & Comput. Sci., Univ. of Michigan, Ann Arbor, MI, USA
Abstract :
We introduce a recursive adaptive group lasso algorithm for real-time penalized least squares prediction that produces a time sequence of optimal sparse predictor coefficient vectors. At each time index the proposed algorithm computes an exact update of the optimal ℓ1,∞-penalized recursive least squares (RLS) predictor. Each update minimizes a convex but nondifferentiable function optimization problem. We develop an on-line homotopy method to reduce the computational complexity. Numerical simulations demonstrate that the proposed algorithm outperforms the ℓ1 regularized RLS algorithm for a group sparse system identification problem and has lower implementation complexity than direct group lasso solvers.
Keywords :
adaptive filters; least squares approximations; optimisation; recursive estimation; signal processing; RLS predictor; adaptive filtering; computational complexity; direct group lasso solvers; group sparse system identification problem; nondifferentiable function optimization problem; numerical simulations; online homotopy method; optimal ℓ1,∞-penalized recursive least squares predictor; optimal sparse predictor coefficient vectors; real-time penalized least squares prediction; recursive adaptive group lasso algorithm; signal processing; time sequence; Complexity theory; Indexes; Least squares approximation; Numerical simulation; Prediction algorithms; Signal processing algorithms; Vectors; Group lasso; RLS; group sparsity; homotopy; mixed norm; system identification;
Journal_Title :
Signal Processing, IEEE Transactions on
DOI :
10.1109/TSP.2012.2192924