DocumentCode
1631804
Title
Non-asymptotic information theoretic bound for some multi-party scenarios
Author
Sharma, Neelam ; Warsi, Naqueeb Ahmad
Author_Institution
Tata Inst. of Fundamental Res., Mumbai, India
fYear
2012
Firstpage
1034
Lastpage
1041
Abstract
In the last few years, there has been a great interest in extending the information-theoretic scenario for the non-asymptotic or one-shot case, i.e., where the channel is used only once. We provide the one-shot rate region for the distributed source-coding (Slepian-Wolf) and the multiple-access channel. Our results are based on defining a novel one-shot typical set based on smooth entropies that yields the one-shot achievable rate regions while leveraging the results from the asymptotic analysis. Our results are asymptotically optimal, i.e., for the distributed source coding they yield the same rate region as the Slepian-Wolf in the limit of unlimited independent and identically distributed (i.i.d.) copies. Similarly for the multiple-access channel the asymptotic analysis of our approach yields the rate region which is equal to the rate region of the memoryless multiple-access channel in the limit of large number of channel uses.
Keywords
channel coding; entropy; memoryless systems; multi-access systems; source coding; Slepian-Wolf coding; asymptotic analysis; distributed source coding; iid copies; independent and identically distributed copies; memoryless multiple-access channel; multiparty scenario; nonasymptotic information theoretic bound; one-shot achievable rate regions; smooth entropies; Channel coding; Data compression; Entropy; Protocols; Random variables; Upper bound;
fLanguage
English
Publisher
ieee
Conference_Titel
Communication, Control, and Computing (Allerton), 2012 50th Annual Allerton Conference on
Conference_Location
Monticello, IL
Print_ISBN
978-1-4673-4537-8
Type
conf
DOI
10.1109/Allerton.2012.6483332
Filename
6483332
Link To Document