Title :
Agrios: A hybrid approach to big array analytics
Author :
Leyshock, Patrick ; Maier, David ; Tufte, Kristin
Author_Institution :
Portland State Univ., Portland, OR, USA
Abstract :
Hybrid systems for analyzing big data integrate an analytic tool and a dedicated data-management platform. The necessary movement of data between the components of a hybrid system can lead to performance problems, if that movement is not managed effectively. We present Agrios, a hybrid analytic system for array-structured data, integrating R and SciDB. Agrios minimizes data movement between the two components of the hybrid, using techniques repurposed from relational database query optimization.
Keywords :
data analysis; data structures; optimisation; query processing; relational databases; Agrios; SciDB; analytic tool; array-structured data; big array analytics; big data analysis; dedicated data-management platform; hybrid analytic system; hybrid approach; relational database query optimization; Arrays; Data handling; Data models; Data storage systems; Information management; Shape; Vectors; R; SciDB; big-array analytics; query optimization;
Conference_Titel :
Big Data, 2013 IEEE International Conference on
Conference_Location :
Silicon Valley, CA
DOI :
10.1109/BigData.2013.6691558