• DocumentCode
    2051285
  • Title

    Datamation: A Quarter of a Century and Four Orders of Magnitude Later

  • Author

    Bertasi, Paolo ; Bonazza, Michele ; Bressan, Marco ; Peserico, Enoch

  • Author_Institution
    Dept. of Inf. Eng., Univ. of Padova, Padova, Italy
  • fYear
    2011
  • fDate
    26-30 Sept. 2011
  • Firstpage
    605
  • Lastpage
    609
  • Abstract
    The combination of the high-performance psort sorting library and of a carefully tuned desktop-class cluster allowed us to improve the previous record on the Datamation sort benchmark by over an order of magnitude, sorting a million 100 byte records from disk to disk in a few dozen milliseconds. Of the many implementation and configuration choices we faced, the most crucial were judicious data placement and access patterns on disk, adoption of UDP sockets instead of MPI, careful pruning of virtually all system daemons, and rejection of ``on demand´´ frequency scaling.
  • Keywords
    application program interfaces; libraries; message passing; pattern clustering; sorting; transport protocols; Datamation; MPI; UDP socket; data access pattern; data placement; desktop-class cluster; high-performance psort sorting library; magnitude later; on demand frequency scaling; system daemon; Benchmark testing; Delay; Linux; Protocols; Software; Sorting; Switches; cluster; datamation; latency; psort; sorting;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Cluster Computing (CLUSTER), 2011 IEEE International Conference on
  • Conference_Location
    Austin, TX
  • Print_ISBN
    978-1-4577-1355-2
  • Electronic_ISBN
    978-0-7695-4516-5
  • Type

    conf

  • DOI
    10.1109/CLUSTER.2011.75
  • Filename
    6061101