DocumentCode :
3559044
Title :
On the Uniqueness of Nonnegative Sparse Solutions to Underdetermined Systems of Equations
Author :
Bruckstein, Alfred M. ; Elad, Michael ; Zibulevsky, Michael
Author_Institution :
Dept. of Comput. Sci., Technion - Israel Inst. of Technol., Haifa
Volume :
54
Issue :
11
fYear :
2008
Firstpage :
4813
Lastpage :
4820
Abstract :
An underdetermined linear system of equations Ax = b with nonnegativity constraint x ges 0 is considered. It is shown that for matrices A with a row-span intersecting the positive orthant, if this problem admits a sufficiently sparse solution, it is necessarily unique. The bound on the required sparsity depends on a coherence property of the matrix A. This coherence measure can be improved by applying a conditioning stage on A, thereby strengthening the claimed result. The obtained uniqueness theorem relies on an extended theoretical analysis of the lscr0 - lscr1 equivalence developed here as well, considering a matrix A with arbitrary column norms, and an arbitrary monotone element-wise concave penalty replacing the lscr1-norm objective function. Finally, from a numerical point of view, a greedy algorithm-a variant of the matching pursuit-is presented, such that it is guaranteed to find this sparse solution. It is further shown how this algorithm can benefit from well-designed conditioning of A .
Keywords :
greedy algorithms; signal processing; sparse matrices; coherence measure; greedy algorithm; linear equations; monotone element-wise concave penalty; nonnegative sparse solution; orthogonal matching pursuit; signal processing; sparse matrices; underdetermined linear system; Constraint theory; Equations; Greedy algorithms; Image processing; Image recognition; Linear systems; Matching pursuit algorithms; Pursuit algorithms; Signal processing; Sparse matrices; $ell _{1}$; Basis pursuit; greedy algorithm; linear system; positive orthant; sparse solution; uniqueness;
fLanguage :
English
Journal_Title :
Information Theory, IEEE Transactions on
Publisher :
ieee
ISSN :
0018-9448
Type :
jour
DOI :
10.1109/TIT.2008.929920
Filename :
4655436
Link To Document :
بازگشت