Title :
A hybrid recommendation algorithm based on Hadoop
Author :
Kunhui Lin ; Jingjin Wang ; Meihong Wang
Author_Institution :
Software Sch., Xiamen Univ., Xiamen, China
Abstract :
Recommender system has been widely used and collaborative filtering algorithm is the most widely used algorithm in recommender system. As scale of recommender system continues to expand, the number of users and items of recommender system is growing exponentially. As a result, the single-node machine implementing these algorithms is time-consuming and unable to meet the computing needs of large data sets. To improve the performance, we proposed a distributed collaborative filtering recommendation algorithm combining k-means and slope one on Hadoop. Apache Hadoop is an open-source organization´s distributed computing framework. In this paper, the former hybrid recommendation algorithm was designed to parallel on MapReduce framework. The experiments were applied to the MovieLens dataset to exploit the benefits of our parallel algorithm. The experimental results present that our algorithm improves the performance.
Keywords :
collaborative filtering; data handling; parallel algorithms; public domain software; recommender systems; Apache Hadoop; MapReduce framework; MovieLens dataset; distributed collaborative filtering recommendation algorithm; hybrid recommendation algorithm; k-means; open-source organization distributed computing framework; parallel algorithm; recommender system; single-node machine; slope one; Algorithm design and analysis; Computers; Educational institutions; Libraries; Hadoop; K-Means; Slope One; hybrid recommendation algorithm;
Conference_Titel :
Computer Science & Education (ICCSE), 2014 9th International Conference on
Conference_Location :
Vancouver, BC
Print_ISBN :
978-1-4799-2949-8
DOI :
10.1109/ICCSE.2014.6926520