Speaker
Robin Hofsaess
(KIT - Karlsruhe Institute of Technology (DE))
Description
In the talk, I want to present our ideas for a data-aware scheduling mechanism for our opportunistic resources attached to GridKa, the T1 center in Germany.
Opportunistic resources are non permanent computing sites (partly with cache storages) distributed in Germany that provide resources for the HEP community from time to time.
We are planning to implement a hash-based distribution of datasets to different resources, inspired by Ceph/CRUSH, in combination with HTCondor scheduling and XRootD caching.
This will enable us to to schedule jobs to the according site without the need of a separate data management.
Author
Robin Hofsaess
(KIT - Karlsruhe Institute of Technology (DE))
Co-authors
Gunter Quast
(KIT - Karlsruhe Institute of Technology (DE))
Manuel Giffels
(KIT - Karlsruhe Institute of Technology (DE))
Matthias Jochen Schnepf
Max Fischer
