TY - JOUR
T1 - Optimal Sparsity Tradeoff in l0-NLMS Algorithm
AU - Al-Shabili, Abdullah
AU - Weruaga, Luis
AU - Jimaa, Shihab
N1 - Publisher Copyright:
© 2016 IEEE.
PY - 2016/8
Y1 - 2016/8
N2 - The l0-normalized least mean squares (l0-NLMS) is arguably the reference gradient adaptive algorithm for sparse system estimation. However, alike all sparse gradient adaptive algorithms, the l0-NLMS performance is sensitive to the (adequate) selection of the tradeoff parameter. Highlighted in this letter, the existence of two convergence modes, linked to the negligible and to the significant taps, paves the way for the convergence analysis, which results in a set of nonlinear (quadratic) convergence equations. Therefrom, the minimization of the steady-state misalignment concludes in the optimal tradeoff, which happens to relate to the NLMS step size, filter length, plant sparsity, and noise level in an extremely compact fashion. Exhaustive simulation experiments show strong agreement between the analytical predictions and the empirical performance.
AB - The l0-normalized least mean squares (l0-NLMS) is arguably the reference gradient adaptive algorithm for sparse system estimation. However, alike all sparse gradient adaptive algorithms, the l0-NLMS performance is sensitive to the (adequate) selection of the tradeoff parameter. Highlighted in this letter, the existence of two convergence modes, linked to the negligible and to the significant taps, paves the way for the convergence analysis, which results in a set of nonlinear (quadratic) convergence equations. Therefrom, the minimization of the steady-state misalignment concludes in the optimal tradeoff, which happens to relate to the NLMS step size, filter length, plant sparsity, and noise level in an extremely compact fashion. Exhaustive simulation experiments show strong agreement between the analytical predictions and the empirical performance.
KW - l-norm
KW - NLMS algorithm
KW - sparsity tradeoff
UR - http://www.scopus.com/inward/record.url?scp=84979882510&partnerID=8YFLogxK
U2 - 10.1109/LSP.2016.2587064
DO - 10.1109/LSP.2016.2587064
M3 - Article
AN - SCOPUS:84979882510
SN - 1070-9908
VL - 23
SP - 1121
EP - 1125
JO - IEEE Signal Processing Letters
JF - IEEE Signal Processing Letters
IS - 8
M1 - 7503121
ER -