Effects of Adaptive Wormhole Routing in Event Builder Networks

Author

Bauer, G. ; Boyer, V. ; Branson, J. ; Brett, A. ; Cano, E. ; Carboni, A. ; Ciganek, M. ; Cittolin, S. ; Erhan, S. ; Gigi, D. ; Glege, F. ; Reino, R. Gomez ; Gulmini, M. ; Mlot, E. Gutierrez ; Gutleber, J. ; Jacobs, C. ; Kim, J.C. ; Klute, M. ; Lipeles, E.

Author_Institution

Massachusetts Inst. of Technol., Cambridge

fYear

2007

fDate

April 29 2007-May 4 2007

Firstpage

1

Lastpage

7

Abstract

The data acquisition system of the CMS experiment at the Large Hadron Collider features a two-stage event builder, which combines data from about 500 sources into full events at an aggregate throughput of 100 GByte/s. To meet the requirements, several architectures and interconnect technologies have been quantitatively evaluated. Both gigabit Ethernet and Myrinet networks will be employed during the first run. Nearly full bi-section throughput can be obtained using a custom software driver for Myrinet based on barrel shifter traffic shaping. This paper discusses the use of Myrinet dual-port network interface cards supporting channel bonding to achieve virtual 5 GBit/s links with adaptive routing to alleviate the throughput limitations associated with wormhole routing. Adaptive routing is not expected to be suitable for high-throughput event builder applications in high-energy physics. To corroborate this claim, results from the CMS event builder pre-series installation at CERN are presented and the problems of wormhole routing networks are discussed.

Keywords

adaptive systems; data acquisition; high energy physics instrumentation computing; local area networks; CERN; Ethernet; LHC; Large Hadron Collider; Myrinet dual-port network interface cards; adaptive wormhole routing; barrel shifter traffic shaping; byte rate 100 GByte/s; custom software driver; data acquisition system; event builder networks; virtual links; Aggregates; Collision mitigation; Computer architecture; Data acquisition; Ethernet networks; Large Hadron Collider; Network interfaces; Routing; Telecommunication traffic; Throughput;

fLanguage

English

Publisher

ieee

Conference_Titel

Real-Time Conference, 2007 15th IEEE-NPSS

Conference_Location

Batavia, IL

Print_ISBN

978-1-4244-0866-5

Electronic_ISBN

978-1-4244-0867-2

Type

conf

DOI

10.1109/RTC.2007.4382749

Filename

4382749