14-16 September 2015
University "La Sapienza", Physics Department
Europe/Rome timezone

IceCube Simulation Production and the Transition to IceProd2

15 Sep 2015, 15:10
20m
Aula Rasetti, 2nd floor (University "La Sapienza", Physics Department)

Aula Rasetti, 2nd floor

University "La Sapienza", Physics Department

Piazzale Aldo Moro, 2 - 00185 Roma - Italy

Speaker

David Schultz (University of Wisconsin-Madison)

Description

IceCube's simulation production relies largely on dynamic, heterogeneous resources spread around the world. Datasets consist of many thousands of job workflow subsets running in parallel as directed acyclic graphs (DAGs) and using varying resources. IceProd is a set of python daemons which process job workflow and maintain configuration and status information on jobs before, during, and after processing. IceProd manages a complex workflow of DAGs to distribute jobs across all computing grids and optimize resource usage. IceProd2 is a new version of IceProd with substantial increases in security, reliability, scalability, and ease of use. It is undergoing testing and will be deployed this fall.

Primary author

David Schultz (University of Wisconsin-Madison)

Presentation Materials