On almost sure convergence of adaptive algorithms

We present an extension of the Furstenberg-Kesten theorem on the convergence of random matrices. This extension is applied to the study of almost sure convergence of certain adaptive algorithms. In particular, we establish that the NLMS algorithm is almost surely convergent under extremely weak necessary and sufficient conditions. We also discuss the relationship of sufficient conditions that have appeared in the literature with our results.