• DocumentCode
    44189
  • Title

    Complex-Valued Filtering Based on the Minimization of Complex-Error Entropy

  • Author

    Songyan Huang ; Chunguang Li ; Yiguang Liu

  • Author_Institution
    Dept. of Inf. Sci. & Electron. Eng., Zhejiang Univ., Hangzhou, China
  • Volume
    24
  • Issue
    5
  • fYear
    2013
  • fDate
    May-13
  • Firstpage
    695
  • Lastpage
    708
  • Abstract
    In this paper, we consider the training of complex-valued filter based on the information theoretic method. We first generalize the error entropy criterion to complex domain to present the complex error entropy criterion (CEEC). Due to the difficulty in estimating the entropy of complex-valued error directly, the entropy bound minimization (EBM) method is used to compute the upper bounds of the entropy of the complex-valued error, and the tightest bound selected by the EBM algorithm is used as the estimator of the complex-error entropy. Then, based on the minimization of complex-error entropy (MCEE) and the complex gradient descent approach, complex-valued learning algorithms for both the (linear) transverse filter and the (nonlinear) neural network are derived. The algorithms are applied to complex-valued linear filtering and complex-valued nonlinear channel equalization to demonstrate their effectiveness and advantages.
  • Keywords
    entropy; filtering theory; gradient methods; learning (artificial intelligence); minimisation; neural nets; CEEC; EBM method; complex error entropy criterion; complex gradient descent approach; complex-error entropy minimization; complex-valued filtering; complex-valued learning algorithm; complex-valued linear filtering; complex-valued nonlinear channel equalization; entropy bound minimization; entropy upper bound; information theoretic method; linear transverse filter; nonlinear neural network; Cost function; Entropy; Learning systems; Minimization; Random variables; Training; Vectors; Complex-valued filtering; entropy bound minimization; minimization of complex-error entropy; neural network;
  • fLanguage
    English
  • Journal_Title
    Neural Networks and Learning Systems, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    2162-237X
  • Type

    jour

  • DOI
    10.1109/TNNLS.2013.2241788
  • Filename
    6450100