Title :
Some results about the Vapnik-Chervonenkis entropy and the rademacher complexity
Author :
Anguita, Davide ; Ghio, Alessandro ; Oneto, Luca ; Ridella, Sandro
Author_Institution :
DITEN - Univ. of Genova, Genoa, Italy
Abstract :
This paper deals with the problem of identifying a connection between the Vapnik-Chervonenkis (VC) Entropy, a notion of complexity introduced by Vapnik in his seminal work, and the Rademacher Complexity, a more powerful notion of complexity, which has been in the limelight of several works in the recent Machine Learning literature. In order to establish this connection, we refine some previously known relationships and derive a new result. Our proposal allows computing an admissible range for the Rademacher Complexity, given a value of the VC-Entropy, and vice versa, therefore opening new appealing research perspectives in the field of assessing the complexity of an hypothesis space.
Keywords :
computational complexity; learning (artificial intelligence); Rademacher complexity; VC-entropy; Vapnik-Chervonenkis entropy; machine learning; Aerospace electronics; Annealing; Complexity theory; Entropy; Extraterrestrial measurements; Hamming distance; Upper bound;
Conference_Titel :
Neural Networks (IJCNN), The 2013 International Joint Conference on
Conference_Location :
Dallas, TX
Print_ISBN :
978-1-4673-6128-6
DOI :
10.1109/IJCNN.2013.6706943