DOMA / TPC Meeting

Wednesday 28 Aug 2019, 17:30 → 18:30 Europe/Zurich

Xrootd

• Wei tried lcmaps as a way to make xrootd and http work with voms credentials. However this has the drawback of introducing a dependency on globus. Brian says that anyway this will be supported by OSG. Fabrizio suggests to use XrdHttpVOMS, which was built for that exact use case, is well documented, regularly maintained and available in EPEL. The code of XrdHttpVOMS is available in gitlab, and it's based on openssl and libvoms2 (also in EPEL). Libvoms2 was made by the VOMS developers and doesn’t have globus dependencies. LibXrdHttpVOMS was made to fulfil Wei's use case for XrdHTTP only. Now Wei wants to see if the code can be borrowed to substitute the 'vomsxrd' package, which historically fulfils the same VOMS use case for the xrootd protocol (and for the records is used e.g. in DPM sites). Fabrizio says that given the very small amount of code in XrdHttpVOMS, it should be pretty easy to reuse it (or copy parts of it) into a future version of vomsxrd, fully satisfying Wei's goal.Smoke tests: Al has activated the smoke tests for xrootd.  Tests should be kept simple, one result a day is enough. Glasgow should be removed from the list.

• Stress tests: Wei was looking at the stress tests and problem with multithreaded transfers. The DOMA stress tests are monitored in kibana and there are currently 3 participating sites Manchester, Prague and slac. Andrea says that on each couple of sites the system is configured not to use more than 130 threads.

• Wei sees also transfers from BNL and the FTS seems misconfigured. Those are the ATLAS functional tests. Since FTS needs the latests clients and neither BNL nor RAL have upgraded there are a lot of failures. The situation will be reviewed in September, These tests are monitored in grafana.

• The links to all the tests are in the TPC twiki monitoring section. https://twiki.cern.ch/twiki/bin/view/LCG/ThirdPartyCopy#Monitoring

WEBdav

• Brian reports that 3 more USCMS sites have been added to the tests. USCMS to satisfy a funding agency deliverable has to move 30% data transfers to non gridftp TPC. Brian wanted to wait for rucio but that is taking longer than required so they are going to start with phedex. (we should add the sites detail to the twiki?)
• We briefly reported about the decision to go ahead with setting up token testing even if we haven’t agreed yet on the type of token. This will require several iterations to get all the pieces together as it concerns also other services like FTS. Oliver comments that there are already a number of scenarios that have been evaluated on how to pass the tokens along the chain of services but this needs to be organised in a written list. In a couple of weeks the AAI token profile will be finalised and hopefully there will be an agreement on it. There’s plenty that can be done in the mean time.
• Smoke tests: we need to shut down Paul’s tests since they run from his machine and the code is in his GitHub area he is the only one who can amend them and he is now on paternity leave.

General

• At the DOMA general meeting in July we decided that to have a way forward with TPC we need the sites to upgrade to the latest versions of storage. DPM already has a TF pushing the upgrade. dcache is the other storage with a large number of sites for which a TF is being setup by WLCG Ops Coord. We agree that we can review the situation with sites every couple of weeks included the introduction of CRIC.

 

17:30 → 17:50 Xrootd Protocol Update

Speaker: Wei Yang (SLAC National Accelerator Laboratory (US))

17:50 → 18:10 HTTP Protocol Update

Speaker: Brian Paul Bockelman (University of Nebraska Lincoln (US))

18:10 → 18:30 Discussion