21–25 Sept 2009
Institut des Cordeliers 15, rue de l'Ecole de Médecine (Métro Odéon) Paris, France
Europe/Paris timezone
<strong>The deadline for paper submission has been extended to 23 October 2009</strong>

The ATLAS ReadOut System - improved performance with the switch-based architecture

24 Sept 2009, 16:15
2h 15m
Institut des Cordeliers 15, rue de l'Ecole de Médecine (Métro Odéon) Paris, France

Institut des Cordeliers 15, rue de l'Ecole de Médecine (Métro Odéon) Paris, France

Poster Systems, installation and commissioning POSTERS SESSION

Speaker

Mr Nicolai Schroer (Ruprecht Karls Universitaet Heidelberg)

Description

About 600 custom-built ReadOut Buffer INput (ROBIN) PCI boards are used in the Data-Collection of the ATLAS experiment at CERN. In the standard setup requests and event data are passed via the PCI interfaces. The performance meets the requirements, but may need to be enhanced for more demanding use cases. Modifications in the software and firmware of the ROBINs have made it possible to improve the performance by using the on-board Gigabit Ethernet interfaces for passing part of the requests and of the data. Details of these modifications as well as measurement results will be presented.

Summary

The custom-built ReadOut Buffer INput (ROBIN) board is used in the ATLAS experiment at CERN
to buffer the event data coming from the ReadOut Drivers (ROD) of the sub-detectors via ~1600
optical links. Per ROBIN three of those links can be connected. The maximum input event fragment
rate is 75-100kHz (first level trigger rate). The about 600 ROBINs are plugged into the PCI slots of
rack mountable PCs (usually 4 per PC), which run the the software to manage the requests by the
Level 2 Trigger (L2) and the Event Builder (EB) as well as delete requests. The connection to the
Data Collection (DC) network is established via Gigabit Ethernet (GbE). About 150 of these PCs
form the ReadOut System (ROS), which can service ~20 kHz rate of requests from L2 for data input
via 2-3 optical links per ROS PC and ~3.5 kHz rate of requests from the EB for data input via all 12
links (4 ROBINs with 3 links each). Certain use cases include Full-Scan requests (similar to EB requests) by L2, which would go far beyond the capabilities of the standard ROS system with respect to the available bandwidth and processing power. For such demanding scenarios the message handling mechanism can be offloaded partially to the individual ROBINs in the so-called Switch-Based scenario, utilizing the on-board
GbE interface for a direct connection to the DC network. To make this possible the FPGA and software for the on-board processor of the ROBIN were modified, allowing the ROBIN to output responses to requests arriving via the network interface like a ROS PC. First measurement results show that a Full-Scan at 20 kHz would be
possible for fragments of ~1kB (which is the canonical size). Details of the implementation and results as well as further plans for improvement will be presented.

Author

Mr Nicolai Schroer (Ruprecht Karls Universitaet Heidelberg)

Co-authors

A. Kugel (Ruprecht Karls Universitaet Heidelberg) A. Misiejuk (Royal Holloway University of London) B. Gorini (CERN) B. Green (Royal Holloway University of London) D. Della Volpe (Universita & INFN, Napoli) F. Wickens (Rutherford Appleton Laboratory) G. Crone (University College London) G. Kieft (Nikhef, Amsterdam) J. Vermeulen (Nikhef, Amsterdam) K. Kordas (University Bern) L. Tremblet (CERN) M. Joos (CERN) P. Teixeira-Dias (Royal Holloway University of London) P. Werner (CERN)

Presentation materials