Speaker
Mr
Stuart Wakefield
(Imperial College)
Description
ProdAgent is a set of tools to assist in producing various data products such as Monte Carlo simulation, prompt reconstruction, re-reconstruction and skimming
In this paper we briefly discuss the ProdAgent architecture, and focus on the experience in using this system in recent computing challenges, feedback from these challenges, and future work. The computing challenges have proven invaluable for scaling the system to the level desired for the first LHC physics runs. The feedback from the recent computing challenges resulted in a design review of some of the ProdAgent core components. Results of this review and the mandate to converge development within the data management sub projects, led to the establishment of the WCore project: a common set of libraries for CMS workflow systems, with the aim of reducing code duplication between sub projects, and increasing maintainability. This paper discusses some of the lessons learned from recent computing challenges and how this experience has been incorporated into the WMCore project.
The current ProdAgent project has shifted towards bulk operations (optimizing database performance) and buffered tasks (so to better handle reliability when interacting with third party components). Two significant areas of development effort are the migration to a common set of libraries (WMCore) for all CMS workflow systems and a system to split and manage work requests between ProdAgents - to better utilise the available resources.
Primary authors
Mr
Ajit Mohapatra
(University of Wisconsin)
Mr
Dave Evans
(Fermi National Accelerator Lab)
Mr
David Mason
(Fermi National Accelerator Lab)
Mr
Diego Romero
(Universidad de Los Andes)
Mr
Frank van Lingen
(California Institute of Technology)
Mr
Giuseppe Codispoti
(University of Bologna and INFN)
Mr
Guillelmo Gomez Ceballos
(Massachusetts Inst. of Technology)
Mr
Jose Hernandez
(Centro de Investigaciones Energetic as Medioambientales y Tecnologicas)
Mr
Maarten Thomas
(Rheinisch-Westfaelische Tech. Hoch.)
Mr
Oliver Gutsche
(Fermi National Accelerator Lab)
Mr
Si Xie
(Massachusetts Inst. of Technology)
Mr
Stephen Foulkes
(Fermi National Accelerator Lab)
Mr
Stephen Gowdy
(CERN)
Mr
Stuart Wakefield
(Imperial College)
