Addressing Big Data challenges for Scientific Data Infrastructure

Author

Demchenko, Y. ; Zhiming Zhao ; Grosso, Paola ; Wibisono, A. ; de Laat, Cees

Author_Institution

Syst. & Network Eng. Group, Univ. of Amsterdam, Amsterdam, Netherlands

fYear

2012

fDate

3-6 Dec. 2012

Firstpage

614

Lastpage

617

Abstract

This paper discusses the challenges that are imposed by Big Data Science on the modern and future Scientific Data Infrastructure (SDI). The paper refers to different scientific communities to define requirements on data management, access control and security. The paper introduces the Scientific Data Lifecycle Management (SDLM) model that includes all the major stages and reflects specifics in data management in modern e-Science. The paper proposes the SDI generic architecture model that provides a basis for building interoperable data or project centric SDI using modern technologies and best practices. The paper explains how the proposed models SDLM and SDI can be naturally implemented using modern cloud based infrastructure services provisioning model.

Keywords

authorisation; cloud computing; data handling; natural sciences computing; SDI; SDI generic architecture model; SDLM model; access control; big data challenges; big data science; cloud based infrastructure services provisioning model; data management; e-science; scientific community; scientific data infrastructure; scientific data lifecycle management; security; Cloud computing; Communities; Data handling; Data models; Data storage systems; Europe; Information management; (SDI); Big Data Science; Cloud; Infrastructure Services; Scientific Data Infrastructure; Scientific Data Lifecycle Management (SDLM);

fLanguage

English

Publisher

ieee

Conference_Titel

Cloud Computing Technology and Science (CloudCom), 2012 IEEE 4th International Conference on

Conference_Location

Taipei

Print_ISBN

978-1-4673-4511-8

Electronic_ISBN

978-1-4673-4509-5

Type

conf

DOI

10.1109/CloudCom.2012.6427494

Filename

6427494