27 September 2004 to 1 October 2004
Interlaken, Switzerland
Europe/Zurich timezone

Distributed Computing Grid Experiences in CMS DC04

29 Sep 2004, 15:00
Ballsaal (Interlaken, Switzerland)


Interlaken, Switzerland

oral presentation Track 5 - Distributed Computing Systems and Experiences Distributed Computing Systems and Experiences




In March-April 2004 the CMS experiment undertook a Data Challenge(DC04). During the previous 8 months CMS undertook a large simulated event production. The goal of the challenge was to run CMS reconstruction for sustained period at 25Hz input rate, distribute the data to the CMS Tier-1 centers and analyze them at remote sites. Grid environments developed in Europe by the LHC Computing Grid (LCG) in Europe and in the US with Grid2003 were utilized to complete the aspects of the challenge. During the simulation phase, US-CMS utilized Grid2003 to simulate and process approximately 17 million events. Simultaneous usage of CPU resources peaked at 1200 CPUs, controlled by a single FTE. Using Grid3 was a milestone for CMS computing in reaching a new magnitude in the number of autonomously cooperating computing sites for production. The use of Grid-based job execution resulted in reducing the overall support effort required to submit and monitor jobs by a factor of two. During the challenge itself, the CMS groups from Italy and Spain used the LCG Grid Environment to satisfy challenge requirements . The LCG Replica Manager was used to transfer the data. The CERN RLS provided the needed replica catalogue functionality. The LCG submission system based on the Resource Broker was used to submit analysis jobs to the sites hosting the data. A CMS dedicated GridICE monitoring was activated to monitor both services and resources. A description of the experiences, successes and lessons learned from both experiences with grid infrastructure is presented.

Primary authors

A. Anzar (FERMILAB) A. Fanfani (INFN-BOLOGNA (ITALY)) A. Heavey (FERMILAB) A. Sciaba' (EIS CERN) A. Zahn (UFL) B. MacEvoy (IMPERIAL COLLEGE LONDON) B. Martelli (INFN-CNAF) C. Grandi (INFN-Bologna) C. Prescott (UFL) D. Bonacorsi (INFN-CNAF) D. Bradley (University of Wisconsin) D. Colling (Imperial College London) F. Donno (EIS CERN) F. Fanzago (INFN-Padova) G. Donvito (INFN-Bari) G. Graham (FERMILAB) G. Maggi (INFN-Bari) H. Tallini (Imperial College London) I. Fisk (FERMILAB) I. Legrand (Caltech) J. Hernandez (CIEMAT Madrid) J. Kaiser (FERMILAB) J. Letts (UCSD) J. Rodriguez (UFL) J. Weigand (FERMILAB) K. Bockjoo (UFL) L Wakefield (Imperial College London) L. Dell'Agnello (INFN-CNAF) L. Giacchetti (FERMILAB) L. Tuura (Northeastern University, Boston) M. Biasotto (INFN-Legnaro) M. Corvo (INFN-Padova) M. Ernst (DESY) M. Mazzucato (INFN-Padova) N. De Filippis (INFN-Bari) N. Kuropatine (FERMILAB) N. Ratnikova (FERMILAB) N. Sinanis (CERN) P. Capiluppi (INFN-Bologna) P. GARCIA-ABIA (CIEMAT) R. Pordes (FERMILAB) S. Campana (EIS CERN) S. Fantinel (INFN-Legnaro) S. Suresh (Caltech) T. Martin (UCSD) T. Perelmutov (FERMILAB) W. Jank (CERN) Y. Wu (FERMILAB)

Presentation Materials