Speaker
Eileen Kuhn
(KIT - Karlsruhe Institute of Technology (DE))
Description
Batch system monitoring and related system monitoring tools allow tracking data streams at different levels. With the introduction of federated data access to the workflows of WLCG it is becoming increasingly important for data centers to understand specific data flows regarding storage element accesses, firewall configurations, or the scheduling of workflows themselves. For this purpose a proof of concept has been implemented at the GridKa Tier1 center for monitoring data streams of batch jobs. The approach aims for a direct integration into the existing batch system to enhance batch job statistics by adding continuous traffic profiles for WLCG jobs and pilots. The presentation will introduce the general concept of the developed tool and integration into the batch system as well as first results of measurements at GridKa.
Author
Eileen Kuhn
(KIT - Karlsruhe Institute of Technology (DE))