Title :
A Hybrid Algorithm for Frequent Pattern Mining Using MapReduce Framework
Author :
Hong-Yi Chang;Yih-Jou Tzang;Jia-Chi Lin;Zih-Huan Hong;Ting-Yun Chi;Chun-Yen Huang
Author_Institution :
Dept. of Manage. Inf. Syst., Nat. Chiayi Univ., Chiayi, Taiwan
Abstract :
Advancements in the field of information technology have resulted in an increase in the speed and amount of data generated. This has resulted in traditional association rules algorithms, such as the Apriori and Frequent Pattern Growth (FP-Growth) algorithms, no longer being able to rapidly explore valuable knowledge in big data. Nowadays, parallel computing with technologies such as MapReduce is commonly used to reduce execution times. Because the FP-Growth algorithm uses an FP-Tree to mine itemsets, decomposing its structure into subtasks is difficult. We developed a method that combines the Apriori and FP-Growth algorithms with MapReduce to rectify this problem. In experiments conducted, we varied the block size of the Mapper to achieve execution performance better than those of the Apriori and FP-Growth algorithms.
Keywords :
"Itemsets","Data mining","Algorithm design and analysis","Heuristic algorithms","Cloud computing","Time complexity"
Conference_Titel :
Computational Intelligence Theory, Systems and Applications (CCITSA), 2015 First International Conference on
DOI :
10.1109/CCITSA.2015.40