Title :
Online learning or tracking of discrete input-output maps
Author_Institution :
Siemens AG, Wien, Austria
fDate :
9/1/1997 12:00:00 AM
Abstract :
This paper shows how a slowly time-varying nonlinear mapping can be learned, if, for every possible input value, the corresponding estimated output value is stored in memory. This representation form can be called “flash map”, or pointwise representation, or look-up table. Thus, very fast access to the mapping is provided. The learning process is performed online during regular operation of the system and must avoid “adaptation holes” which could occur when some of the points are more frequently updated than other points. After analyzing the problems of previous approaches we show how radial basis function networks can be modified for flash maps and present the tent roof tensioning algorithm which is exclusively designed for learning flash maps. The convergence of the tent roof tensioning algorithm is proved. Finally, we compare the two approaches concluding that under the flash map restriction the tent roof tensioning algorithm is the better choice for learning low-dimensional mappings, if a polygonal approximation of the desired mapping is sufficiently smooth
Keywords :
associative processing; content-addressable storage; convergence of numerical methods; feedforward neural nets; generalisation (artificial intelligence); interpolation; learning systems; nonlinear control systems; real-time systems; associative memory; convergence; discrete input-output maps; flash map; generalisation; interpolation; nonlinear mappings; online learning; polygonal approximation; radial basis function networks; tent roof tensioning algorithm; time-varying nonlinear mapping; Algorithm design and analysis; Approximation algorithms; Associative memory; Control systems; Convergence; Nonlinear control systems; Radial basis function networks; Table lookup; Tracking loops; Trajectory;
Journal_Title :
Systems, Man and Cybernetics, Part A: Systems and Humans, IEEE Transactions on
DOI :
10.1109/3468.618264