DOMA / TPC Meeting

Wednesday 13 Jan 2021, 17:30 → 18:35 Europe/Zurich

Topic: WLCG DOMA TPC Meeting

Join Zoom Meeting
https://cern.zoom.us/j/99836057922?pwd=ZFhWN3NpYi9oZmwvM3pIRE9zdzFnZz09

Meeting ID: 998 3605 7922
Passcode: 733660
One tap mobile
+41315280988,,99836057922# Switzerland
+41432107042,,99836057922# Switzerland

Dial by your location
        +41 31 528 09 88 Switzerland
        +41 43 210 70 42 Switzerland
        +41 43 210 71 08 Switzerland
        +33 1 7037 2246 France
        +33 1 7037 9729 France
        +33 1 8699 5831 France
Meeting ID: 998 3605 7922
Find your local number: https://cern.zoom.us/u/aeB4ArMgmT

17:30 → 17:50 SRM - tape T0 - T1 transfers

Speaker: Mihai Patrascoiu (CERN)

Update from Mihai who's on holiday

My thoughts on the topic:

- The Gfal2 change to retrieve macaroons/SE-issued tokens (unofficial v2.19.1) proved able to do the job. Petr tested SRM + HTTP TPC transfers using this change and they worked

- FTS-devel-next is already configure to not request SE-issued tokens, delegating this responsibility entirely to Gfal2. This instance has had these changes since before the Christmas break

 

My next steps:

- Implement macaroon retrieval in Gfal2 instead of relying on "x509-scitokens-issuer-client" package (change agreed with Brian)

- Stream out some edge cases I found out during my testing

- Move the testing ground from FTS-devel-next to FTS-devel instance. This means the change will become part of the Gfal2 develop branch (and due for the next release). Same thing applies for FTS: I will port the change which allows configuring FTS whether to obtain macaroons itself or not (leaving Gfal2 to do it) to the develop branch

17:50 → 18:05 Experiments production

Speakers: Alessandra Forti (University of Manchester (GB)), Diego Davila Foyo (Univ. of California San Diego (US)), Petr Vokac (Czech Technical University (CZ))

• EOS WebDAV push issue root#1373 (ATLAS don't use push mode except for cloud storage R&D)
• All ATLAS T1 dCache tape endpoints works fine with SRM+HTTP using FTS devel-next
• StoRM tape endpoint doesn't work with SRM+HTTP GGUS:149954
  • today this seems to work - what was changed?
• StoRM poor WebDAV performance & efficiency GGUS:150181
  • today it looks OK (but tested only with less concurrent connections)
• DPM EPEL testing with fixes for LCGDM-2953 (close called twice -> thread fd mismatch / race)
• FTS Pilot with streaming enabled (failing TPC can fallback to streaming)
• Davix with curl backend release plans?
  • FTS servers including devel-next still use neon/0.0.29
  • we should use "final" software for our (stress) test
• ? Implementation / configuration status ?
  • ? waiting for stable OSG XRootD 5.1
  • ? RAL ECHO - HTTP-TPC seems to work in testbed
  • ? Dynafed - issues with UTF-8 in certificate subject
• ATLAS production infrastructure TPC status
  • Enabled sites grafana monitoring (7 days)
  • GGUS for three remaining T1 with a production endpoint but without HTTP-TPC as primary protocol
    • disccussion with RAL to enable a production end point for ECHO
  • transfer volume for last 30 days
    • 42% SRM
    • 31% davs
    • 26% gsiftp
    • 1% xroot
  • storage site preferred TPC protocol
    • 38x WebDAV (21x DPM, 12x dCache, 1x Dynafed(?), 1x EOS, 1x StoRM, 2x XRootD)
    • 32x SRM+GridFTP (2x DPM, 18x dCache, 12x StoRM)
    • 19x GridFTP (8x DPM, 1x dCache, 2x ECHO, 8x XRootD)

 

18:05 → 18:15 Token Authorization testbed

Speakers: Andrea Ceccanti (Universita e INFN, Bologna (IT)), Andrea Ceccanti (Unknown), Jaroslav Guenther (CERN)

18:15 → 18:20 HTTP Protocol Update

Speaker: Brian Paul Bockelman (University of Nebraska Lincoln (US))

18:20 → 18:25 Xrootd Protocol Update

Speaker: Wei Yang (SLAC National Accelerator Laboratory (US))

18:25 → 18:30 AOB