9–13 Jul 2018
Sofia, Bulgaria
Europe/Sofia timezone

IceProd - A dataset management system for IceCube: Update

11 Jul 2018, 12:00
15m
Hall 7 (National Palace of Culture)

Hall 7

National Palace of Culture

presentation Track 3 – Distributed computing T3 - Distributed computing

Speaker

David Schultz (University of Wisconsin-Madison)

Description

IceCube is a cubic kilometer neutrino detector located at the south pole. IceProd is IceCube’s internal dataset management system, keeping track of where, when, and how jobs run. It schedules jobs from submitted datasets to HTCondor, keeping track of them at every stage of the lifecycle. Many updates have happened in the last years to improve stability and scalability, as well as increase user access. Major additions include better heterogenous job scheduling, resource requests and tracking, monitoring, and multi-user support. Along the way, the IceProd codebase switched from Python 2 to Python 3.

Primary author

David Schultz (University of Wisconsin-Madison)

Co-author

Juan Carlos Diaz Velez (Universidad de Guadalajara-CUValles)

Presentation materials