Title :
Partial Stepwise Learning for General Multi-dimensional Classification Problem
Author :
Yoshida, Y. ; Matsubara, T. ; Ikushima, Y. ; Zhou, Tian ; Aoyama, T. ; Umeno, H.
Author_Institution :
Fac. of Eng., Miyazaki Univ.
Abstract :
We discuss the multi-dimensional exclusive-OR (EOR) problems and the extension, general classification problem. These problems can be solved by multi-layer neural networks and the back propagation learning (BP) in systematic processing. However, the solution is reasonable in case of small dimension, i.e., under 6th, where the number of data is 26=64. Over 7th..., we haven´t effective approach yet. It is very hard to find convergence path toward the global minimum to classify general cases. To break the limitation, we propose a partial stepwise learning for the BP, which is derived by a kind of symmetric character found in teaching data set. Where, there is no clear-cut symmetry but indistinct one; that is, the symmetry is defined for most of elements, but not for small parts. We used the ambiguous symmetric idea to get initial-guess for connections among neurons. Thus; we got a stepwise learning, and had solve EOR and generalized classifications less than 11th/10th
Keywords :
backpropagation; neural nets; pattern classification; back propagation learning; multidimensional exclusive-OR classification problem; multilayer neural network; partial stepwise learning; Convergence; Education; Electronic mail; Information processing; Large-scale systems; Multi-layer neural network; Neural networks; Neurons; Classification; EOR; Multi-Dimensional Problems; Neural Network; XOR;
Conference_Titel :
SICE-ICASE, 2006. International Joint Conference
Conference_Location :
Busan
Print_ISBN :
89-950038-4-7
Electronic_ISBN :
89-950038-5-5
DOI :
10.1109/SICE.2006.315172