19-23 May 2014
Europe/Paris timezone

Measuring WLCG data streams at batch job level

21 May 2014, 10:15
Auditorium Marcel Vivargent (LAPP)

Auditorium Marcel Vivargent


9 Chemin de Bellevue 74940 Annecy-le-Vieux FRANCE <b>GPS coordinates :</b> N 45° 55' 14.002'' E 6° 9' 33.998''
Security & Networking Security and networking


Eileen Kuhn (KIT - Karlsruhe Institute of Technology (DE))


Batch system monitoring and related system monitoring tools allow tracking data streams at different levels. With the introduction of federated data access to the workflows of WLCG it is becoming increasingly important for data centers to understand specific data flows regarding storage element accesses, firewall configurations, or the scheduling of workflows themselves. For this purpose a proof of concept has been implemented at the GridKa Tier1 center for monitoring data streams of batch jobs. The approach aims for a direct integration into the existing batch system to enhance batch job statistics by adding continuous traffic profiles for WLCG jobs and pilots. The presentation will introduce the general concept of the developed tool and integration into the batch system as well as first results of measurements at GridKa.

Primary author

Eileen Kuhn (KIT - Karlsruhe Institute of Technology (DE))

Presentation materials