Title :
Active Learning Based on Single-Hidden Layer Feed-Forward Neural Network
Author :
Ran Wang;Sam Kwong;Qingshan Jiang;Ka-Chun Wong
Author_Institution :
Shenzhen Key Lab. for High Performance Data Min., Shenzhen Inst. of Adv. Technol., Shenzhen, China
Abstract :
In this paper, we propose two stream-based active learning algorithms for single-hidden layer feed-forward neural networks (SLFNs) trained by extreme learning machine (ELM). Uncertainty and inconsistency are adopted as two sample selection criteria. Uncertainty reflects the nondeterminacy of a sample among different decision classes, which is calculated by information entropy or Gini-index. Inconsistency reflects the disagreement of the sample between its conditional features and decision labels, which is calculated by the lower approximations in fuzzy rough sets. Experimental results demonstrate that inconsistency-based strategy is more effective than uncertainty based strategy for SLFNs under stream-based environment.
Keywords :
"Training","Uncertainty","Artificial neural networks","Approximation algorithms","Information entropy","Complexity theory"
Conference_Titel :
Systems, Man, and Cybernetics (SMC), 2015 IEEE International Conference on
DOI :
10.1109/SMC.2015.377