DocumentCode :
2729819
Title :
A Cooperative, Self-Configuring High-Availability Solution for Stream Processing
Author :
Jeong-Hyon Hwang ; Ying Xing ; Cetintemel, U. ; Zdonik, S.
Author_Institution :
Dept. of Comput. Sci., Brown Univ., Providence, RI, USA
fYear :
2007
fDate :
15-20 April 2007
Firstpage :
176
Lastpage :
185
Abstract :
We present a collaborative, self-configuring high availability (HA) approach for stream processing that enables low-latency failure recovery while incurring small run-time overhead. Our approach relies on a novel fine-grained checkpointing model that allows query fragments at each server to be backed up at multiple other servers and recovered collectively (in parallel) when there is a failure. In this paper, we first address the problem of determining the appropriate query fragments at each server. We then discuss, for each fragment, which server to use as its backup as well as the proper checkpoint schedule. We also introduce and analyze operator-specific delta-checkpointing techniques to reduce the overall HA cost. Finally, we quantify the benefits of our approach using results from our prototype implementation and a detailed simulator.
Keywords :
checkpointing; query processing; collaborative self-configuring high availability approach; cooperative self-configuring high-availability solution; delta checkpointing; fine-grained checkpointing model; low-latency failure recovery; stream processing; Availability; Checkpointing; Collaboration; Computer science; Costs; Delay; Patient monitoring; Runtime; Safety; Virtual prototyping;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Data Engineering, 2007. ICDE 2007. IEEE 23rd International Conference on
Conference_Location :
Istanbul
Print_ISBN :
1-4244-0802-4
Type :
conf
DOI :
10.1109/ICDE.2007.367863
Filename :
4221666
Link To Document :
بازگشت