Title :
The covering problem and μ-dependent adaptive algorithms
Author :
Bucklew, James A. ; Sethares, William A.
Author_Institution :
Dept. of Electr. & Comput. Eng., Wisconsin Univ., Madison, WI, USA
fDate :
10/1/1994 12:00:00 AM
Abstract :
The paper presents a family of techniques, called adaptive covering algorithms, which solve a particular covering problem-how to best cover a target shape using a set of simply parameterized elements. The algorithms, inspired by adaptive filtering techniques, provide a computationally simple, robust, and efficient alternative to more traditional methods such as Bayesian approaches, convex hulls, and multi-layer perceptrons. The paper develops a theoretical understanding of the adaptive covering algorithms by relating their behavior via weak convergence techniques to the evolution of a deterministic ordinary differential equation (ODE). In the process, the authors give new convergence results for a class of step size-dependent recursive algorithms. Stability and instability of the ODE can be interpreted in terms of the local stability/instability of the algorithm. In terms of the covering problem, candidate coverings tend to improve as more data is gathered whenever the ODE is stable. Several examples are given which demonstrate the ideas and which verify that the analysis accurately predicts the true behavior of the algorithms
Keywords :
adaptive filters; convergence of numerical methods; differential equations; filtering and prediction theory; iterative methods; recursive functions; μ-dependent adaptive algorithms; adaptive covering algorithms; adaptive filtering; convergence results; covering problem; deterministic ordinary differential equation; instability; simply parameterized elements; stability; step size-dependent recursive algorithms; target shape; weak convergence techniques; Adaptive algorithm; Adaptive filters; Bayesian methods; Convergence; Differential equations; Filtering algorithms; Multilayer perceptrons; Robustness; Shape; Stability;
Journal_Title :
Signal Processing, IEEE Transactions on