Speaker
David Schultz
(University of Wisconsin-Madison)
Description
As part of the IceCube Neutrino Observatory's move to the Pelican Platform for data transfer, our production workflow management tools also needed to be updated. There were two major changes happening at the same time: moving from X.509 certificates to tokens, and gathering the tokens at the initial dataset submission rather than during the job processing. Some significant problems had to be overcome, including keeping the tokens refreshed throughout the lifetime of the dataset and transferring tokens from the workflow tool to HTCondor. Along the way, one useful side effect has been a new fail-fast mechanic at dataset submission, when the token is created and scopes are checked for user permission.
Author
David Schultz
(University of Wisconsin-Madison)