Title :
Dualities Between Entropy Functions and Network Codes
Author :
Chan, Terence ; Grant, Alex
Author_Institution :
Inst. for Telecommun. Res., Univ. of South Australia, Adelaide, SA
Abstract :
In communications networks, the capacity region of multisource network coding is given in terms of the set of entropy functions Gamma*. More broadly, determination of Gamma* would have an impact on converse theorems for multi-terminal problems in information theory. This paper provides several new dualities between entropy functions and network codes. Given a function g ges 0 defined on all subsets of N random variables, we provide a construction for a network multicast problem which is ldquosolvablerdquo if and only if g is the entropy function of a set of quasi-uniform random variables. The underlying network topology is fixed and the multicast problem depends on g only through link capacities and source rates. A corresponding duality is developed for linear network codes, where the constructed multicast problem is linearly solvable if and only if g is linear group characterizable. Relaxing the requirement that the domain of g be subsets of random variables, we obtain a similar duality between polymatroids and the linear programming bound. These duality results provide an alternative proof of the insufficiency of linear (and abelian) network codes, and demonstrate the utility of non-Shannon inequalities to tighten outer bounds on network coding capacity regions.
Keywords :
entropy codes; linear codes; linear programming; multicast communication; random codes; source coding; telecommunication network topology; communication network topology; converse theorems; entropy function; information theory; linear network codes; linear programming bound; multisource network coding; network multicast problem; non Shannon inequalities; polymatroids; quasi uniform random variables; Australia; Communication networks; Cramer-Rao bounds; Entropy; Information theory; Linear programming; Mutual information; Network coding; Network topology; Random variables; Duality; Ingleton´s inequality; LP bounds; entropy functions; network codes; polymatroids; pseudovariables;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2008.928963