Title :
Neural networks learning with L1 criteria and its efficiency in linear prediction of speech signals
Author :
Namba, Munehiro ; Kamata, H. ; Ishida, Yoshihisa
Author_Institution :
Sch. of Sci. & Technol., Meiji Univ., Japan
Abstract :
Classical learning techniques such as the backpropagation algorithm minimizes the expectation of the squared error that arises between the actual output and the desired output of supervised neural networks. The network trained by such a technique, however, does not behave in the desired way when it is embedded in the system that deals with non-Gaussian signals. As the least absolute estimation is known to be robust for noisy signals or a certain type of non-Gaussian signals, the network trained with this criterion might be less sensitive to the type of signal. The paper discusses the least absolute error criterion for error minimization in supervised neural networks. The authors pay particular attention to its efficiency for the linear prediction of speech. The computational loads of the conventional approaches to this estimation have been much heavier than the usual least squares estimator. But the proposed approach can significantly improve the analysis performance, since the method is based on the simple gradient descent algorithm
Keywords :
errors; estimation theory; learning (artificial intelligence); linear predictive coding; neural nets; speech processing; L1 criteria; backpropagation algorithm; computational loads; error minimization; gradient descent algorithm; least absolute error criterion; least absolute estimation; neural network learning; noisy signals; non-Gaussian signals; speech signal linear prediction; supervised neural networks; Intelligent networks; Least squares approximation; Maximum likelihood estimation; Neural networks; Performance analysis; Robustness; Signal processing; Signal processing algorithms; Speech processing; Speech synthesis;
Conference_Titel :
Spoken Language, 1996. ICSLP 96. Proceedings., Fourth International Conference on
Conference_Location :
Philadelphia, PA
Print_ISBN :
0-7803-3555-4
DOI :
10.1109/ICSLP.1996.607834