DOMA / TPC Meeting

Wednesday 4 Aug 2021, 16:00 → 17:05 Europe/Zurich

Topic: WLCG DOMA TPC Meeting

Join Zoom Meeting
https://cern.zoom.us/j/99836057922?pwd=ZFhWN3NpYi9oZmwvM3pIRE9zdzFnZz09

Meeting ID: 998 3605 7922
Passcode: 733660
One tap mobile
+41315280988,,99836057922# Switzerland
+41432107042,,99836057922# Switzerland

Dial by your location
        +41 31 528 09 88 Switzerland
        +41 43 210 70 42 Switzerland
        +41 43 210 71 08 Switzerland
        +33 1 7037 2246 France
        +33 1 7037 9729 France
        +33 1 8699 5831 France
Meeting ID: 998 3605 7922
Find your local number: https://cern.zoom.us/u/aeB4ArMgmT

16:00 → 16:10 SRM+HTTP tape access

Speakers: Mihai Patrascoiu (CERN), Petr Vokac (Czech Technical University (CZ))

srm+https-with-fts.odp

srm+https-with-fts.pdf

SRM+HTTPS preferred TURL issue

• preferred TURL_3RD_PARTY_PROTOCOLS is currently global FTS configuration option
• option c) is currently preferred way to go - no development, just configuration
  • for future it could be useful to have more general mechanism to pass parameters to underlying gfal library when submitting FTS transfer (overwrite FTS global gfal configuration) - generalized option d), but it is not worth of effort to implement specific TURL_3RD_PARTY_PROTOCOLS
  • there was also proposal from FTS devel to implement per storage URL configurable gfal2 parameters which would also solve this issue
• supported TURL can be limited by dCache and StoRM to specific protocol
• dCache
  • allows to run multiple SRM instances associated with specific doors/protocols
  • TURL can use protocols from doors associated with SRM instance
• INFN-T1 tape
  • ATLAS, CMS and LHCb - each have dedicated instance - OK, easy
  • one shared by multiple other VOs - still should be possible to define TURL protocol per storage area / per supported VO

ATLAS

• Initial tests started copying 100TB to INFN-T1
• GGUS tickets opened for SRM+https tests possibly the challenges

 

16:10 → 16:20 Future uniform tape access

Speakers: Oliver Keeble (CERN), Paul Millar

16:20 → 16:30 XrootD 5.1.x news

Speaker: Wei Yang (SLAC National Accelerator Laboratory (US))

16:30 → 16:40 Experiments production

Speakers: Alessandra Forti (University of Manchester (GB)), Diego Davila Foyo (Univ. of California San Diego (US)), Petr Vokac (Czech Technical University (CZ))

dCache default HTTP movers limit seems to cause troubles

• StoRM gives up early because it doesn't receive any byte from dCache GGUS:153084
• static limit doesn't fit all our use-cases (fast copy2scratch vs. often slow / long directio)
  • sites hassitate to set high number not to overload storage
  • file can be opened at the beginning of job and used for several hours
  • many files can be kept open by one job
  • movers released only after 300s after killing process with files opened from dCache or in case process segfaults
    • even though OS send FIN packet to terminate TCP connection
• would it make sense to dynamically scale number of movers according load
  • I/O, bandwidth, ...

CMS Status

Total sites	53
In Production	41 (77%)
Passed LoadTests (TFC issues)	2/12
Passed Manual tests	2/12
Have a WebDAV endpoint	5/12
on Hold	3/12

 

ATLAS Status

• 64/70 T2+T1 done
• 3/5 xrootd
• 2/5 echo
• 1/5 Storm

16:40 → 16:50 Network data challenges

Speakers: Dr Riccardo Di Maria (CERN), Rizart Dona (CERN)

16:50 → 17:00 Token Authorization testbed

Speakers: Andrea Ceccanti (Unknown), Andrea Ceccanti (Universita e INFN, Bologna (IT))

17:00 → 17:05 AOB