Title :
L1 and L∞ minimization via a variant of Karmarkar´s algorithm
Author :
Ruzinsky, Steven A. ; Olsen, Elwood T.
Author_Institution :
Illinois Inst. of Technol., Chicago, IL, USA
fDate :
2/1/1989 12:00:00 AM
Abstract :
Simple iterative algorithms are presented for L1 and L∞ minimization (regression) based on a variant of Karmarkar´s linear programming algorithm. Although these algorithms are based on entirely different theoretical principles to the popular IRLS (iteratively reweighted least squares) algorithm, they have almost identical matrix operations. Also presented are the results of a Monte Carlo study comparing the numerical convergence properties of the Karmarkar algorithm for L1 minimization to those of an IRLS and a simplex algorithm. The test problem involves L 1 estimation of AR (autoregressive) model parameters. The Karmarkar algorithm outperformed IRLS by achieving higher numerical accuracy in fewer iterations. Techniques for reducing the computational cost per iteration of the Karmarkar L1 algorithm are discussed
Keywords :
Monte Carlo methods; convergence of numerical methods; information theory; iterative methods; linear programming; minimisation; Karmarkar´s algorithm; Monte Carlo study; iterative algorithms; linear programming; minimization; numerical convergence; regression; Acoustic signal processing; H infinity control; Least squares methods; Linear programming; Mathematics; Minimax techniques; Minimization methods; Multidimensional signal processing; Speech processing; Vectors;
Journal_Title :
Acoustics, Speech and Signal Processing, IEEE Transactions on