DocumentCode
3245146
Title
A parallel Hyper-Surface Classifier for high dimensional data
Author
He, Qing ; Wang, Qun ; Du, Chang-Ying ; Ma, Xu-dong ; Shi, Zhong-zhi
Author_Institution
Key Lab. of Intell. Inf. Process., CAS, Beijing, China
fYear
2010
fDate
20-21 Oct. 2010
Firstpage
338
Lastpage
343
Abstract
The enlarging volumes of data resources produced in real world makes classification of very large scale data a challenging task. Therefore, parallel process of very large high dimensional data is very important. Hyper-Surface Classification (HSC) is approved to be an effective and efficient classification algorithm to handle two and three dimensional data. Though HSC can be extended to deal with high dimensional data with dimension reduction or ensemble techniques, it is not trivial to tackle high dimensional data directly. Inspired by the decision tree idea, an improvement of HSC is proposed to deal with high dimensional data directly in this work. Furthermore, we parallelize the improved HSC algorithm (PHSC) to handle large scale high dimensional data based on MapReduce framework, which is a current and powerful parallel programming technique used in many fields. Experimental results show that the parallel improved HSC algorithm not only can directly deal with high dimensional data, but also can handle large scale data set. Furthermore, the evaluation criterions of scaleup, speedup and sizeup validate its efficiency.
Keywords
decision trees; learning (artificial intelligence); parallel programming; pattern classification; MapReduce framework; classification algorithm; data resources; decision tree idea; dimension reduction; ensemble techniques; high dimensional data; parallel hyper-surface classifier; parallel programming technique; HSC; Machine learning; MapReduce; PHSC; Parallel classification;
fLanguage
English
Publisher
ieee
Conference_Titel
Knowledge Acquisition and Modeling (KAM), 2010 3rd International Symposium on
Conference_Location
Wuhan
Print_ISBN
978-1-4244-8004-3
Type
conf
DOI
10.1109/KAM.2010.5646172
Filename
5646172
Link To Document