DocumentCode :
44189
Title :
Complex-Valued Filtering Based on the Minimization of Complex-Error Entropy
Author :
Songyan Huang ; Chunguang Li ; Yiguang Liu
Author_Institution :
Dept. of Inf. Sci. & Electron. Eng., Zhejiang Univ., Hangzhou, China
Volume :
24
Issue :
5
fYear :
2013
fDate :
May-13
Firstpage :
695
Lastpage :
708
Abstract :
In this paper, we consider the training of complex-valued filter based on the information theoretic method. We first generalize the error entropy criterion to complex domain to present the complex error entropy criterion (CEEC). Due to the difficulty in estimating the entropy of complex-valued error directly, the entropy bound minimization (EBM) method is used to compute the upper bounds of the entropy of the complex-valued error, and the tightest bound selected by the EBM algorithm is used as the estimator of the complex-error entropy. Then, based on the minimization of complex-error entropy (MCEE) and the complex gradient descent approach, complex-valued learning algorithms for both the (linear) transverse filter and the (nonlinear) neural network are derived. The algorithms are applied to complex-valued linear filtering and complex-valued nonlinear channel equalization to demonstrate their effectiveness and advantages.
Keywords :
entropy; filtering theory; gradient methods; learning (artificial intelligence); minimisation; neural nets; CEEC; EBM method; complex error entropy criterion; complex gradient descent approach; complex-error entropy minimization; complex-valued filtering; complex-valued learning algorithm; complex-valued linear filtering; complex-valued nonlinear channel equalization; entropy bound minimization; entropy upper bound; information theoretic method; linear transverse filter; nonlinear neural network; Cost function; Entropy; Learning systems; Minimization; Random variables; Training; Vectors; Complex-valued filtering; entropy bound minimization; minimization of complex-error entropy; neural network;
fLanguage :
English
Journal_Title :
Neural Networks and Learning Systems, IEEE Transactions on
Publisher :
ieee
ISSN :
2162-237X
Type :
jour
DOI :
10.1109/TNNLS.2013.2241788
Filename :
6450100
Link To Document :
بازگشت