10–14 Oct 2022
Confindustria Cuneo - Casa Betania
Europe/Paris timezone

User data access and challenges

12 Oct 2022, 09:50
25m
Confindustria Cuneo - Casa Betania

Confindustria Cuneo - Casa Betania

Via Vittorio Bersezio, 9 12100 Cuneo CN Italy
HTCondor user presentations Workshop Session

Speakers

Christoph Beyer Thomas Hartmann (Deutsches Elektronen-Synchrotron (DE))

Description

To complement grid production workflows, the National Analysis Facility (NAF) at DESY aims to provide individual users with an easy way without hurdles to process their data fast.
Since users are used to plain file paths, a number of storages are mounted as network mounts on the NAF HTCondor nodes. But with users showing a wide range of access patterns, we encountered occassionally problems with mounts and file access affecting the cluster stability.
To better understand the interplay between users, kernel and file system clients, we are now working on extending our monitoring. With the already available detailed event monitoring on the storage instances, we are going to add a complementary status overview of the execution side with the aim of a consolidated view the of storage and compute clusters.

Desired slot length 15
Speaker release Yes

Authors

Krunoslav Sever (Deutsches Elektronen-Synchrotron DESY) Martin Flemming (Deutsches Elektronen-Synchrotron (DESY)) Thomas Hartmann (Deutsches Elektronen-Synchrotron (DE))

Co-author

Presentation materials