Title :
Mining frequent itemsets based on projection array
Author :
He, Hai-tao ; Cao, Hai-yan ; Yao, Rui-xia ; Ren, Jia-dong ; Hu, Chang-zhen
Author_Institution :
Coll. of Inf. Sci. & Eng., Yanshan Univ., Qinhuangdao, China
Abstract :
Frequent itemsets mining is a crucial problem in the field of data mining. Although many related studies have been suggested, these algorithms may suffer from high computation cost and spatial complexity in dense database, especially when mining long frequent itemsets or support threshold is very lower. To address this problem, a new data structure called P Array is proposed. P Array makes use of data horizontally and vertically like Bit Table FI, and those itemsets that co_occurence with single frequent items are found by computing intersection in P Array. Then, a new algorithm, call MFIPA, is proposed based on P Array. Some frequent itemsets which have the same supports as single frequent item can be found firstly by connecting the single frequent item with every nonempty subsets of its projection, then all other frequent itemsets can be found by using depth-first search strategy. The experimental results show that the proposed algorithm is superior to Bit Table FI in execution efficiency and memory requirement, especially for dense database.
Keywords :
computational complexity; data mining; data structures; tree searching; MFIPA; P array; bit table FI; data mining; data structure; dense database; depth-first search strategy; execution efficiency; frequent itemsets mining; memory requirement; projection array; single frequent items; spatial complexity; Algorithm design and analysis; Arrays; Data mining; Itemsets; Memory management; Depth-first search; Frequent itemsets; Projection array;
Conference_Titel :
Machine Learning and Cybernetics (ICMLC), 2010 International Conference on
Conference_Location :
Qingdao
Print_ISBN :
978-1-4244-6526-2
DOI :
10.1109/ICMLC.2010.5581018