Adaptive systems as optimal processors

This paper suggests that adaptive filters can be the direct results of optimization problems, if a suitable optimization criterion is used, together with a practical set of constraints. That idea is different from traditional concepts, where adaptive algorithms are used as "real-time" approximations to an "optimal" processor. By allowing the optimal processor to be a stochastic operator, adaptive systems are introduced into the optimization process.