DocumentCode
1304290
Title
Any code of which we cannot think is good
Author
Coffey, John T. ; Goodman, Ani Rodney M
Author_Institution
Dept. of Electr. Eng., California Inst. of Technol., Pasadena, CA, USA
Volume
36
Issue
6
fYear
1990
fDate
11/1/1990 12:00:00 AM
Firstpage
1453
Lastpage
1461
Abstract
A central paradox of coding theory concerns the existence and construction of the best codes. Virtually every linear code is good, in the sense that it meets the Gilbert-Varshamov bound on distance versus redundancy. Despite the sophisticated constructions for codes derived over the years, however, no one has succeeded in demonstrating a constructive procedure that yields such codes over arbitrary symbol fields. Using the theory of Kolmogorov complexity, it is shown that this statement holds true in a rigorous mathematical sense: any linear code that is truly random, in the sense that there is no concise way of specifying the code, is good. Furthermore, random selection of a code that does contain some constructive pattern results, with probability bounded away from zero, in a code that does not meet the Gilbert-Varshamov bound regardless of the block length of the code. In contrast to the situation for linear codes, it is shown that there are effectively random nonlinear codes which have no guarantee on distance. In addition, it is shown that the techniques of Kolmogorov complexity can be used to derive typical properties of classes of codes in a novel way
Keywords
encoding; error correction codes; Gilbert-Varshamov bound; Kolmogorov complexity; arbitrary symbol fields; coding theory; linear code; random nonlinear codes; Entropy; Geometry; Hamming distance; Linear code; Writing;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/18.59944
Filename
59944
Link To Document