• DocumentCode
    2420348
  • Title

    GrayWulf: Scalable Software Architecture for Data Intensive Computing

  • Author

    Simmhan, Yogesh ; Barga, R. ; van Ingen, C. ; Nieto-Santisteban, M. ; Dobos, Lubomir ; Li, Ning ; Shipway, M. ; Szalay, Alexander S. ; Werner, Stefan ; Heasley, J.

  • Author_Institution
    Microsoft Res., Redmond, WA
  • fYear
    2009
  • fDate
    5-8 Jan. 2009
  • Firstpage
    1
  • Lastpage
    10
  • Abstract
    Big data presents new challenges to both cluster infrastructure software and parallel application design. We present a set of software services and design principles for data intensive computing with petabyte data sets, named GrayWulf. These services are intended for deployment on a cluster of commodity servers similar to the well-known Beowulf clusters. We use the Pan-STARRS system currently under development as an example of the architecture and principles in action.
  • Keywords
    software architecture; Beowulf clusters; GrayWulf; Pan-STARRS system; cluster infrastructure software; parallel application design; petabyte data sets; Software architecture;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    System Sciences, 2009. HICSS '09. 42nd Hawaii International Conference on
  • Conference_Location
    Big Island, HI
  • ISSN
    1530-1605
  • Print_ISBN
    978-0-7695-3450-3
  • Type

    conf

  • DOI
    10.1109/HICSS.2009.235
  • Filename
    4755781
    • Link To Document
    https://search.isc.ac/dl/search/defaultta.aspx?DTC=49&DC=2420348