Title :
New algorithms for efficient mining of association rules
Author :
Shen, Li ; Shen, Hong ; Cheng, Ling
Author_Institution :
Sch. of Comput. & Inf. Technol., Griffith Univ., Nathan, Qld., Australia
Abstract :
Discovery of association rules is an important data mining task. Several algorithms have been proposed to solve this problem. Most of them require repeated passes over the database, which incurs huge I/O overhead and high synchronization expense in parallel cases. There are a few algorithms trying to reduce these costs. But they contains weaknesses such as often requiring high pre-processing cost to get a vertical database layout, containing much redundant computation in parallel cases, and so on. We propose new association mining algorithms to overcome the above drawbacks: through minimizing the I/O cost and effectively controlling the computation cost. Experiments on well-known synthetic data show that our algorithms consistently outperform a priori, one of the best algorithms for association mining, by factors ranging from 2 to 4 in most cases. Also, our algorithms are very easy to be parallelized, and we present a parallelization for them based on a shared-nothing architecture. We observe that the parallelism in our parallel approach is developed more sufficiently than in two of the best existing parallel algorithms
Keywords :
associative processing; data mining; parallel algorithms; I/O overhead; association rules; data mining; parallel algorithms; parallelization; shared-nothing architecture; synchronization expense; Association rules; Computational efficiency; Concurrent computing; Costs; Data mining; Information technology; Itemsets; Parallel algorithms; Parallel processing; Transaction databases;
Conference_Titel :
Frontiers of Massively Parallel Computation, 1999. Frontiers '99. The Seventh Symposium on the
Conference_Location :
Annapolis, MD
Print_ISBN :
0-7695-0087-0
DOI :
10.1109/FMPC.1999.750605