Backpropagation algorithm in higher order neural network

The supervised backpropagation learning scheme is used to develop a training algorithm for multilayer higher-order neural networks (HONNs). By restructuring the basic HONN architecture, the traditional backpropagation algorithm can be extended to multilayer HONNs. The TC pattern recognition problem is used to compare the performances of various HONNs with different numbers of hidden layers, different numbers of processing elements, and different orders. Simulation results show that, in many causes, the HONN with the same number of training iterations worked better than the conventional first-order networks