WLCG DOMA BDT Meeting

Wednesday 18 May 2022, 16:30 → 17:30 Europe/Zurich

Brian Paul Bockelman (University of Wisconsin Madison (US)), Maria Arsuaga Rios (CERN), Petr Vokac (Czech Technical University in Prague (CZ))

Topic: WLCG DOMA BDT Meeting

Merged to xrootd fixes for how it handles tokens for the scope.create

• now prevents any destructive actions
  • necessary to implemented renames correctly with posix backend
• code merged last week - hopefully by next week deployed on testbed
  • XRootD and EOS instance used for compliance tests is not currently available
• unfortunately this is not part of XRootD 5.4.x branch
  • we have to wait for XRootD 5.5

FTS

• large refactoring for EGI Check-in + also integration of CILogon
  • running token tests with dCache
• require scopes in the offline token
  • without scopes FTS use introspection - best effort
  • subject + scope -> delegation id (distinguish read/write activity)
    • add issuer
    • add audience(?)
  • in the future EGI tokens will also include specific scopes
• WLCG vs. AARC profile
  • WLCG profile contain wlcg.ver scope
• we need dedicated meeting Rucio + FTS + WLCG AuthZ
  • FTS & tokens briefly discussed during WLCG AuthZ meeting
  • token handling refactoring in FTS -> several topics that needs to be clarified

Rucio

• token testbed soon
• deletion did not work - minor update soon
• start work on tokens in summer by new rucio developer
  • uploads / downloads / deletions
  • improvements planned also for token submission to FTS

TAPE REST

• FNAL will provide dCache REST implementation after next week dCache workshop
• gfal2 2.21 release with TAPE REST support in ~ two weeks

Packet marking

• Nebraska would like to join testbed with their XRootD

AOB

• more inteligent FTS & HTTP-TPC pull/push/stream fallback
  • require propagation of HTTP code back to the TPC client (FTS)
  • details in the attached slides

16:30 → 16:35 Hot topics

Advertisement: successful DPM to dCache migration in less than 24 hours of 5PB production storage with 50M objects (files & directories) ... this is the most simple way to get reasonable WLCG JWT token support for "DPM" (more ads June GDB)

16:35 → 16:50 Token Authorization testbed

Speaker: Francesco Giacomini (INFN CNAF)

16:50 → 17:05 Tape REST access

Speaker: Cedric Caffy (CERN)

17:05 → 17:20 Packet marking

Speakers: Marian Babik (CERN), Shawn Mc Kee (University of Michigan (US))

Three items for today:

• We are planning the next packet marking meeting for June, please fill out the Newdle poll:  https://newdle.cern.ch/newdle/zbM9rL3b
• Tristan Sullivan has been testing packet marking via eBPF and initial results are very encouraging

Idle Cpu Available Memory Interrupts / second Throughput Retransmits Server, no eBPF 88.27% 115 G 115447     Server, eBPF 86.65% 115 G 117443     Client, no eBPF 77.40% 246 Gi 336667 92.9 Gbps 0 Client, eBPF 74.77% 246 Gi 342910 92.8 Gbps 0

 

• Meeting with dCache to discuss packet marking / flow labeling on Friday

See project information at https://www.scitags.org/ 

17:20 → 17:30 AOB

Gfal2_HTTPCopy_Fallback_Mechanism.pdf