Title :
Generalization Characteristics of Complex-Valued Feedforward Neural Networks in Relation to Signal Coherence
Author :
Hirose, A. ; Yoshida, S.
Author_Institution :
Dept. of Electr. Eng. & Inf. Syst., Univ. of Tokyo, Tokyo, Japan
fDate :
4/1/2012 12:00:00 AM
Abstract :
Applications of complex-valued neural networks (CVNNs) have expanded widely in recent years-in particular in radar and coherent imaging systems. In general, the most important merit of neural networks lies in their generalization ability. This paper compares the generalization characteristics of complex-valued and real-valued feedforward neural networks in terms of the coherence of the signals to be dealt with. We assume a task of function approximation such as interpolation of temporal signals. Simulation and real-world experiments demonstrate that CVNNs with amplitude-phase-type activation function show smaller generalization error than real-valued networks, such as bivariate and dual-univariate real-valued neural networks. Based on the results, we discuss how the generalization characteristics are influenced by the coherence of the signals depending on the degree of freedom in the learning and on the circularity in neural dynamics.
Keywords :
function approximation; generalisation (artificial intelligence); learning (artificial intelligence); neural nets; signal processing; amplitude-phase-type activation function; bivariate real-valued neural networks; coherent imaging systems; complex-valued feedforward neural networks; dual-univariate real-valued neural networks; function approximation; generalization characteristics; learning; neural dynamics; radar systems; real-valued feedforward neural networks; signal coherence; temporal signal interpolation; Biological neural networks; Coherence; Feedforward neural networks; Neurons; Signal to noise ratio; Vectors; Complex-valued neural network; function approximation; generalization; supervised learning;
Journal_Title :
Neural Networks and Learning Systems, IEEE Transactions on
DOI :
10.1109/TNNLS.2012.2183613