DocumentCode :
1254215
Title :
Capacity of multilevel threshold devices
Author :
Diep, Thanh A.
Author_Institution :
Dept. of Risk Anal. & Decision Syst., Visa Internat., San Francisco, CA, USA
Volume :
44
Issue :
1
fYear :
1998
fDate :
1/1/1998 12:00:00 AM
Firstpage :
241
Lastpage :
255
Abstract :
The principal purpose of this research is to discover the underlying properties of linear multilevel threshold devices and networks of linear multilevel threshold devices. The main theoretical developments of this investigation entail generalizing the function-counting theorem associated with linear bi-level threshold devices to that of linear multilevel threshold devices. The investigation reveals surprising connections that underlie linear inequalities, linear separability, linear ordering, and region counting. The results have implications in the field of geometric probability. Computations based on theoretical analysis support Brown´s (1964) conjecture and suggest that k/(k-1) is a natural definition for the information-storage capacity of a k-level threshold device. A lower bound on the number of weights required to implement a universal network of k-level threshold devices is derived. Finally, it is shown that the Vapnik-Chervonenki (1971)s dimension (VC-dimension) for the class of multilevel threshold function is d+1 for pattern vectors in ℛd . This VC-dimension is also linked to an error-rate bound for multilevel threshold functions within the framework of uniform learnability
Keywords :
channel capacity; learning systems; linear network analysis; linear systems; probability; Brown´s conjecture; Vapnik-Chervonenkis dimension; computational learning theory; error-rate bound; function-counting theorem; geometric probability; information-storage capacity; linear bi-level threshold devices; linear inequalities; linear multilevel threshold device; linear multilevel threshold networks; linear ordering; linear separability; lower bound; multilevel threshold devices capacity; multilevel threshold function; pattern vectors; region counting; uniform learnability; universal network; weights; Information analysis; Postal services; Risk analysis; Vectors; Virtual colonoscopy;
fLanguage :
English
Journal_Title :
Information Theory, IEEE Transactions on
Publisher :
ieee
ISSN :
0018-9448
Type :
jour
DOI :
10.1109/18.651031
Filename :
651031
Link To Document :
بازگشت