Title :
Transcendental functions in backward error propagation
Author :
Rosen, Bruce E. ; Goodwin, James M. ; Vidal, Jacques J.
Author_Institution :
Dept. of Comput. Sci., California Univ., Los Angeles, CA, USA
Abstract :
Trigonometric transcendental functions such as the sine and cosine functions are shown to be effective as transfer functions in a backpropagation network. Unlike the logistic function, the cosine and sine transfer functions are capable of solving the XOR problem with one processing node. Experiments using the sine and cosine instead of the logistic function show that these function may converge more quickly for certain classes of problems, especially when polynomial correlations are found in training data. Taylor series expansion shows why, for some problems, these functions may give faster convergence than the logistic function
Keywords :
convergence of numerical methods; functional analysis; neural nets; series (mathematics); transfer functions; Taylor series expansion; XOR; backpropagation network; backward error propagation; convergence; cosine functions; neural nets; polynomial correlations; sine functions; transfer functions; trigonometric transcendental functions; Backpropagation; Computer errors; Convergence; Logistics; Machine intelligence; Measurement standards; Neural networks; Polynomials; Taylor series; Transfer functions;
Conference_Titel :
Systems, Man and Cybernetics, 1990. Conference Proceedings., IEEE International Conference on
Conference_Location :
Los Angeles, CA
Print_ISBN :
0-87942-597-0
DOI :
10.1109/ICSMC.1990.142100