Title :
An improved extreme learning machine with adaptive growth of hidden nodes based on particle swarm optimization
Author :
Min-Ru Zhao ; Jian-Ming Zhang ; Fei Han
Author_Institution :
Sch. of Comput. Sci. & Commun. Eng., Jiangsu Univ., Zhenjiang, China
Abstract :
Extreme learning machines (ELMs) for generalized single-hidden-layer feedforward networks which perform well in both regression and classification applications have caused a lot of attention. To obtain compact network architecture with better generalization performance, an improved ELM with adaptive growth of hidden nodes (AG-ELM) combined with particle swarm optimization (PSO) is proposed in this study. PSO is used to select the optimal weights and biases to overcome the deficiency of the standard AG-ELM. All parameters in one network are represented by one particle in PSO, and the dimension of the particle increases in the training process. Simulation results on various test problems verify that the proposed algorithm achieves more compact network architecture and has better generalization performance with less steps than classical AG-ELM.
Keywords :
feedforward neural nets; generalisation (artificial intelligence); learning (artificial intelligence); particle swarm optimisation; AG-ELM; PSO; classification application; generalization performance; generalized single-hidden-layer feedforward networks; hidden nodes adaptive growth; improved extreme learning machine; network architecture; network parameters; particle swarm optimization; regression application; Accuracy; Educational institutions; Feedforward neural networks; Particle swarm optimization; Testing; Training; extreme learning machine; network architecture; particle swarm optimization;
Conference_Titel :
Neural Networks (IJCNN), 2014 International Joint Conference on
Conference_Location :
Beijing
Print_ISBN :
978-1-4799-6627-1
DOI :
10.1109/IJCNN.2014.6889712