DocumentCode
2051285
Title
Datamation: A Quarter of a Century and Four Orders of Magnitude Later
Author
Bertasi, Paolo ; Bonazza, Michele ; Bressan, Marco ; Peserico, Enoch
Author_Institution
Dept. of Inf. Eng., Univ. of Padova, Padova, Italy
fYear
2011
fDate
26-30 Sept. 2011
Firstpage
605
Lastpage
609
Abstract
The combination of the high-performance psort sorting library and of a carefully tuned desktop-class cluster allowed us to improve the previous record on the Datamation sort benchmark by over an order of magnitude, sorting a million 100 byte records from disk to disk in a few dozen milliseconds. Of the many implementation and configuration choices we faced, the most crucial were judicious data placement and access patterns on disk, adoption of UDP sockets instead of MPI, careful pruning of virtually all system daemons, and rejection of ``on demand´´ frequency scaling.
Keywords
application program interfaces; libraries; message passing; pattern clustering; sorting; transport protocols; Datamation; MPI; UDP socket; data access pattern; data placement; desktop-class cluster; high-performance psort sorting library; magnitude later; on demand frequency scaling; system daemon; Benchmark testing; Delay; Linux; Protocols; Software; Sorting; Switches; cluster; datamation; latency; psort; sorting;
fLanguage
English
Publisher
ieee
Conference_Titel
Cluster Computing (CLUSTER), 2011 IEEE International Conference on
Conference_Location
Austin, TX
Print_ISBN
978-1-4577-1355-2
Electronic_ISBN
978-0-7695-4516-5
Type
conf
DOI
10.1109/CLUSTER.2011.75
Filename
6061101
Link To Document