Title :
Regularization using jittered training data
Author :
Reed, Russell ; Oh, Seho ; Marks, Robert J., II
Author_Institution :
Dept. of Electr. Eng., Washington Univ., Seattle, WA, USA
Abstract :
The authors investigate the training of a layered perceptron with jittered data. They study the effect of generating additional training data by adding noise to the input data and show that is introduces convolutional smoothing of the target function. Training using such jittered data is shown, under a small variance assumption, to be equivalent to Lagrangian regularization with a derivative regularizer. Training with jitter allows regularization within the conventional layered perceptron architecture
Keywords :
feedforward neural nets; learning (artificial intelligence); Lagrangian regularization; convolutional smoothing; derivative regularizer; feedforward neural net; jittered training data; layered perceptron; target function smoothing; training; Additive noise; Convolution; Distributed computing; Jitter; Lagrangian functions; Multilayer perceptrons; Noise generators; Random variables; Smoothing methods; Training data;
Conference_Titel :
Neural Networks, 1992. IJCNN., International Joint Conference on
Conference_Location :
Baltimore, MD
Print_ISBN :
0-7803-0559-0
DOI :
10.1109/IJCNN.1992.227178