DocumentCode
44189
Title
Complex-Valued Filtering Based on the Minimization of Complex-Error Entropy
Author
Songyan Huang ; Chunguang Li ; Yiguang Liu
Author_Institution
Dept. of Inf. Sci. & Electron. Eng., Zhejiang Univ., Hangzhou, China
Volume
24
Issue
5
fYear
2013
fDate
May-13
Firstpage
695
Lastpage
708
Abstract
In this paper, we consider the training of complex-valued filter based on the information theoretic method. We first generalize the error entropy criterion to complex domain to present the complex error entropy criterion (CEEC). Due to the difficulty in estimating the entropy of complex-valued error directly, the entropy bound minimization (EBM) method is used to compute the upper bounds of the entropy of the complex-valued error, and the tightest bound selected by the EBM algorithm is used as the estimator of the complex-error entropy. Then, based on the minimization of complex-error entropy (MCEE) and the complex gradient descent approach, complex-valued learning algorithms for both the (linear) transverse filter and the (nonlinear) neural network are derived. The algorithms are applied to complex-valued linear filtering and complex-valued nonlinear channel equalization to demonstrate their effectiveness and advantages.
Keywords
entropy; filtering theory; gradient methods; learning (artificial intelligence); minimisation; neural nets; CEEC; EBM method; complex error entropy criterion; complex gradient descent approach; complex-error entropy minimization; complex-valued filtering; complex-valued learning algorithm; complex-valued linear filtering; complex-valued nonlinear channel equalization; entropy bound minimization; entropy upper bound; information theoretic method; linear transverse filter; nonlinear neural network; Cost function; Entropy; Learning systems; Minimization; Random variables; Training; Vectors; Complex-valued filtering; entropy bound minimization; minimization of complex-error entropy; neural network;
fLanguage
English
Journal_Title
Neural Networks and Learning Systems, IEEE Transactions on
Publisher
ieee
ISSN
2162-237X
Type
jour
DOI
10.1109/TNNLS.2013.2241788
Filename
6450100
Link To Document