Speaker
Jens Rehn
(CERN)
Description
Distributed data management at LHC scales is a staggering task, accompanied by
equally challenging practical management issues with storage systems and wide-area
networks. CMS data transfer management system, PhEDEx, is designed to handle this
task with minimum operator effort, automating the workflows from large scale
distribution of HEP experiment datasets down to reliable and scalable transfers of
individual files over frequently unreliable infrastructure. Over the last year PhEDEx
has matured to the point of handling virtually all CMS production data transfers. CMS
pushes equally its own components to perform and the heavy investment into peer
projects at all levels, from technical details to grid standards to world-wide
projects, to ensure the endto-end service is of sufficient quality. We present the
throughput and service quality we have reached in the current daily 24/7 production
work, the steps taken in LCG service challenges for the next generation transfer
service, and the resulting changes in performance. We also report results from our
scalability stress tests on PhEDEx alone. We offer an analysis of transfer-related
problems we have encountered and how they have been affecting CMS data management.
Primary authors
Dr
Daniele - on behalf of the CMS Collaboration Bonacorsi
(INFN-CNAF, Bologna, Italy)
Lassi Tuura
(Northeastern University)
Tim Barrass
(Bristol University)
Co-authors
Anastasios Papageorgiou
(Imperial College, London)
Andreas Nowack
(RWTH-Aachen)
Artem Trunov
(CC IN2P3)
Brian Bockelm
(University of Nebraska-Licoln)
Chia-Ming Kuo
(National Central University, Chung-li)
Christos Filippidis
(NCSR Demokritos)
Craig Prescott
(University fo Florida)
Daniele Bonacorsi
(INFN-CNAF)
Derek Feichtinger
(CERN)
Dimitri Bourilkov
(University of Florida)
Federico Calzolari
(SNS Pisa)
Francesco Tehrani
(INFN-Roma)
Giacinto Donvito
(INFN-Bari)
James Letts
(University of California, San Diego)
Jens Rehn
(CERN)
Jose Hernandez
(CIEMAT)
Klaus Rabbertz
(University of Karlsruhe)
Mait Muentel
(National Institute of Chemical Physics and Biophysics, Tallinn)
Mario Kadastik
(National Institute of Chemical Physics and Biophysics, Tallinn)
Massimo Biasotto
(INFN-Legnaro)
Michael Ernst
(DESY)
Olga Kodolova
(Scobeltcyn Institute of Nuclear Physics)
Preston Smith
(Purdue University)
Stein de Weirdt
(IIHE ULB-VUB)
Stuart Wakefield
(Imperial College, London)
Suresh Singh
(Caltech)
Yujun Wu
(FNAL)
