Analysis of the misadjustment of BP network and an improved algorithm

The authors analyze the misadjustment of the conventional backpropagation (BP) network introduced by the momentum factor α and its disadvantageous effect on the network, and propose an improved algorithm with stochastic attenuation momentum factor α(k). Analysis and simulations show that the momentum misadjustment is a nonnegligible factor affecting the convergence precision of the BP network. Compared with the conventional BP algorithm, the improved algorithm can effectively cancel the negative effect of α on a network and improve the convergence performance of the network