Author_Institution :
Dept. of Electr. Eng., Princeton Univ., NJ, USA
Abstract :
Supervised learning networks based on a decision-based formulation are explored. More specifically, a decision-based neural network (DBNN) is proposed, which combines the perceptron-like learning rule and hierarchical nonlinear network structure. The decision-based mutual training can be applied to both static and temporal pattern recognition problems. For static pattern recognition, two hierarchical structures are proposed: hidden-node and subcluster structures. The relationships between DBNN´s and other models (linear perceptron, piecewise-linear perceptron, LVQ, and PNN) are discussed. As to temporal DBNN´s, model-based discriminant functions may be chosen to compensate possible temporal variations, such as waveform warping and alignments. Typical examples include DTW distance, prediction error, or likelihood functions. For classification applications, DBNN´s are very effective in computation time and performance. This is confirmed by simulations conducted for several applications, including texture classification, OCR, and ECG analysis
Keywords :
decision theory; image classification; learning (artificial intelligence); neural nets; signal processing; ECG analysis; OCR; decision-based mutual training; decision-based neural networks; hidden-node; hierarchical nonlinear network structure; likelihood functions; linear perceptron; model-based discriminant functions; perceptron-like learning rule; piecewise-linear perceptron; prediction error; signal/image classification; static pattern recognition; subcluster structures; supervised learning networks; temporal variations; texture classification; waveform warping; Analytical models; Computational modeling; Computer networks; Electrocardiography; Image classification; Neural networks; Optical character recognition software; Pattern recognition; Predictive models; Supervised learning;