Title :
An improved sampling algorithm for landmark windows over weighted streaming data
Author :
Lu, Hong ; Zhang, Longbo ; Wang, Jinmiao ; Wang, Fengying
Author_Institution :
Sch. of Comput. Sci., Shandong Univ. of Technol., Zibo, China
Abstract :
This paper discusses the random sampling algorithm for landmark windows over weighted streaming data, and presents a new algorithm by improving weighted random sampling (WRS) algorithm with a reservoir. When a new data item vi with weight wi arrives, a random number ui is generated, and a key ki is calculated by wi and ui for the data item. We maintain a candidate sample set by the keys of data items, and the keys of older data items is decreased periodically. The theoretic analysis and experiments show that the algorithm is effective and efficient for continuous data streams processing.
Keywords :
data handling; media streaming; reservoirs; sampling methods; continuous data streams processing; landmark windows; random sampling algorithm; reservoir; weighted streaming data; Algorithm design and analysis; Conferences; Data models; Information processing; Maintenance engineering; Medical services; Reservoirs; data stream; landmark window; random sampling algorithm;
Conference_Titel :
Intelligent Control and Automation (WCICA), 2010 8th World Congress on
Conference_Location :
Jinan
Print_ISBN :
978-1-4244-6712-9
DOI :
10.1109/WCICA.2010.5554637