Title :
Eigenvalue characterization of the capacity of discrete memoryless channels with invertible channel matrices
Author :
Cotae, Paul ; Moskowitz, Ira S. ; Kang, Myong H.
Author_Institution :
Electr. Eng. Dept., Univ. of the District of Columbia, Washington, DC, USA
Abstract :
We investigate the capacity of finite-input finite-output discrete memoryless channels (DMC) whose channel matrix is n à n square and furthermore is assumed to be nonsingular with n linearly independent real eigenvectors. For any given DMC with such a channel matrix, we characterize the mutual information in terms of its eigenvalues. Our main result, obtained by using the method of Lagrange multipliers, is to derive an analytic expression for the capacity, depending on the eigenvectors and the eigenvalues of the invertible channel matrix. In particular, by using the inverse eigenvalue problem, we characterize the capacity of (2, 2) channels, with invertible channel matrices, in terms of lower and upper bounds that exist in the literature. In addition, numerical examples are provided, and probability of error is discussed.
Keywords :
eigenvalues and eigenfunctions; memoryless systems; telecommunication channels; communication channel; discrete memoryless channels; eigenvalue characterization; finite-input finite- output DMC; inverse eigenvalue problem; invertible channel matrices; Channel capacity; Eigenvalues and eigenfunctions; Laboratories; Lagrangian functions; Memoryless systems; Monte Carlo methods; Multiaccess communication; Mutual information; Random variables; Upper bound; Capacity; DMC; Information theory; Inverse Eigenvalue Problem;
Conference_Titel :
Information Sciences and Systems (CISS), 2010 44th Annual Conference on
Conference_Location :
Princeton, NJ
Print_ISBN :
978-1-4244-7416-5
Electronic_ISBN :
978-1-4244-7417-2
DOI :
10.1109/CISS.2010.5464747