Title :
Monte Carlo query processing of uncertain multidimensional array data
Author :
Ge, Tingjian ; Grabiner, David ; Zdonik, Stan
Author_Institution :
Dept. of Comput. Sci., Univ. of Kentucky, Lexington, KY, USA
Abstract :
Array database systems are architected for scientific and engineering applications. In these applications, the value of a cell is often imprecise and uncertain. There are at least two reasons that a Monte Carlo query processing algorithm is usually required for such uncertain data. Firstly, a probabilistic graphical model must often be used to model correlation, which requires a Monte Carlo inference algorithm for the operations in our database. Secondly, mathematical operators required by science and engineering domains are much more complex than those of SQL. State-of-the-art query processing uses Monte Carlo approximation. We give an example of using Markov Random Fields combined with an array´s chunking or tiling mechanism to model correlated data. We then propose solutions for two of the most challenging problems in this framework, namely the expensive array join operation, and the determination and optimization of stopping conditions of Monte Carlo query processing. Finally, we perform an extensive empirical study on a real world application.
Keywords :
Markov processes; Monte Carlo methods; approximation theory; database management systems; mathematical operators; probability; query processing; Markov random fields; Monte Carlo approximation; Monte Carlo inference algorithm; Monte Carlo query processing algorithm; array chunking mechanism; array database systems; array tiling mechanism; mathematical operators; probabilistic graphical model; uncertain multidimensional array data; Arrays; Monte Carlo methods; Query processing; Semantics; Temperature distribution; Temperature sensors;
Conference_Titel :
Data Engineering (ICDE), 2011 IEEE 27th International Conference on
Conference_Location :
Hannover
Print_ISBN :
978-1-4244-8959-6
Electronic_ISBN :
1063-6382
DOI :
10.1109/ICDE.2011.5767887