DOMA / TPC Meeting

Wednesday 17 Mar 2021, 16:00 → 17:05 Europe/Zurich

Topic: WLCG DOMA TPC Meeting

Join Zoom Meeting
https://cern.zoom.us/j/99836057922?pwd=ZFhWN3NpYi9oZmwvM3pIRE9zdzFnZz09

Meeting ID: 998 3605 7922
Passcode: 733660
One tap mobile
+41315280988,,99836057922# Switzerland
+41432107042,,99836057922# Switzerland

Dial by your location
        +41 31 528 09 88 Switzerland
        +41 43 210 70 42 Switzerland
        +41 43 210 71 08 Switzerland
        +33 1 7037 2246 France
        +33 1 7037 9729 France
        +33 1 8699 5831 France
Meeting ID: 998 3605 7922
Find your local number: https://cern.zoom.us/u/aeB4ArMgmT

1 Network data challenges: ESCAPE tools

Speaker: Rizart Dona (CERN)

Leveraging ESCAPE monitoring & testing tools for the WLCG data challenges.pdf

2 SRM+HTTP tape access

Speakers: Mihai Patrascoiu (CERN), Petr Vokac (Czech Technical University (CZ))

TAPE Testbed

• Available tape endpoints: INFN-T1 (StoRM), BNL (dCache 6.2)
• All disk storage implementation (dCache, DPM, Echo, EOS, StoRM, XRootD)
• Rucio DOMA RSE name: TAPE_"site"_"implementation"_{TAPE,DISK}

FTS (fts3-devel)

• necessary config updates
• TURL_3RD_PARTY_PROTOCOLS=https;gsiftp;root
  • this will come together with new gfal that use integrated SciTokens "library"
  • right now it is possible to use fts3-devel-next which is already configured

TESTS

• Functional Test TAPE
  • every hour transfer 1GB file from / to each site (rule removed after 4 days)
  • basic transfer monitoring in Kibana
  • full debug info in fts3-devel logs (direct link from Kibana page)
  • (currently doesn't work for tapes - require FTS configuration update)
• What kind of tests we would like to see to be confident for switching production instances to SRM+HTTP?
• Do we want to include fraction or all ATLAS & CMS TAPE endpoints?
  • Fraction is sufficient to be sure Rucio -> FTS -> gfal -> SRM+HTTP chain works
  • Quite a lot of communication would be necessary to include all TAPEs

3 Future uniform tape access

Speakers: Oliver Keeble (CERN), Paul Millar

4 Experiments production

Speakers: Alessandra Forti (University of Manchester (GB)), Diego Davila Foyo (Univ. of California San Diego (US)), Petr Vokac (Czech Technical University (CZ))

ATLAS

• Status: 51 / 77 (T0&T1&T2)
  • all T0+T1 except RAL
  • 40% data volume transferred with HTTP-TPC (15-20% with TAPE that can't be move yet)
  • EOS ATLAS back with HTTP-TPC
    • works fine except for one site GGUS:151000
    • weird CentOS7 libcurl behavior for KEK CA
      • NSS error -8054 (SEC_ERROR_REUSED_ISSUER_AND_SERIAL)
• GGUS:150896 StoRM site with Lustre backend and STOR-932
  • does anybody knows if `du --bytes --summarize /path/to/storage` is usable?
  • how long does it take to walk through 10M directories with 10M files using `du`?
    • few seconds? more?
  • we expect updates at least every hour - it should be cheap
  • did not we discussed configurable script for StoRM?
• Storage issued tokens validity vs. X509 proxy/voms expiration
  • I guess it is OK to obtain (restricted) token which can be valid for longer time
    • dCache - ignore proxy & voms expiration, max lifetime 168H (rejects request with longer validity)
    • DPM, EOS, XRootD - ignore proxy & voms expiration, max lifetime 24H (requests with longer validity capped)
    • StoRM use voms extension lifetime and ignore proxy expiration

5 Token Authorization testbed

Speakers: Andrea Ceccanti (Unknown), Andrea Ceccanti (Universita e INFN, Bologna (IT))

6 http and xrootd protocol news

Speakers: Brian Paul Bockelman (University of Nebraska Lincoln (US)), Wei Yang (SLAC National Accelerator Laboratory (US))

7 AOB