WLCG MW Readiness WG 14th meeting Minutes - December 2nd 2015 - VIRTUAL!

WG twiki

• MiddlewareReadinessArchive

Agenda

• https://indico.cern.ch/e/MW-Readiness_14

Summary

• New versions are now being under test via the ATLAS workflow. The dCache v.2.10.44 and v.2.14.0 and HTCondor v.8.4.1 verifications are already completed. Details in the table further below.
• BDII v. 5.2.23 is the new MW product being verified at Brunel on CentOS7 and completed at GRIF-IRFU.
• The ARC-CE v.5.03 verification is completed for CMS.
• The ARGUS Collaboration met on Nov. 6th and Dec. 2nd. Notes relevant to MW Readiness will be added after the 2nd meeting.
• Please comment on the suggested date for the next meeting: Wednesday 20th January 2016 at 4pm CET. Alternative date, if multiple objections will be 27th January 2016 at 4pm. Objections should be sent to wlcg-ops-coord-wg-middleware@cernNOSPAMPLEASE.ch

Attendance

• This meeting is VIRTUAL.

Minutes of previous meeting

The minutes of the last (13th) meeting HERE are assumed approved (no correction received).

Verification status report

ATLAS workflow Readiness Verification Status:

MW Product	version	Volunteer Site(s)	pakiti client installation status	Comment on testing on CentOS7	Other comments
DPM	1.8.10	Edinburgh	OK up-to-date	test machine setup at Glasgow for this, waiting to complete the Atlas specific configuration	All done as per https://its.cern.ch/jira/browse/MWREADY-87
StoRM	1.11.9	QMUL & CNAF	OK up-to-date	n/a	problems running panda jobs @CNAF manually fixed by David Cameron. A SRM_AUTHORIZATION_FAILURE still remaining as per https://its.cern.ch/jira/browse/MWREADY-61
dCache	2.10.44 & 2.14.0	Triumf (2.10.44) & NDGF (2.14.0)	Manually installed at NDGF which is running ubuntu. Our developers are working on the debian packaging. Details https://its.cern.ch/jira/browse/MWREADY-93	n/a	Triumf https://its.cern.ch/jira/browse/MWREADY-94 and NDGF verification https://its.cern.ch/jira/browse/MWREADY-70 completed. A.O.B. Can someone help to make progress with the DESY offer to test dCache on Prometheus as per https://its.cern.ch/jira/browse/MWREADY-36?
HT-Condor (condor-g)	8.4.1	CERN	OK up-to-date	n/a	completed via the ATLAS pilot factory as per https://its.cern.ch/jira/browse/MWREADY-39
FTS3	3.4.0	CERN	OK up-to-date	n/a	this version is being installed this week. It will also be tested for the CMS workflow as per https://its.cern.ch/jira/browse/MWREADY-99
BDII	5.2.23	Brunel & GRIF-IRFU	Not applicable. These are virtual hosts that won't be used on the long run.	yes!	Successfully verified at GRIF-IRFU as per https://its.cern.ch/jira/browse/MWREADY-97

CMS workflow Readiness Verification Status:

MW Product	version	Volunteer Site	pakiti client installation status	Comment for testing on CentOS7	Other comments
DPM	1.8.10	GRIF	OK up-to-date	GRIF plans to run tests on CentOS7 in Q4 2015 as per https://its.cern.ch/jira/browse/MWREADY-71. What exactly can be done now?	problems showed-up with DPM-DSI 1.9.5-8 and gridftp redirection as per https://its.cern.ch/jira/browse/MWREADY-89
dCache	2.13.12	PIC	OK up-to-date	n/a	On-going. Ticket is https://its.cern.ch/jira/browse/MWREADY-91
EOS	4.0.6 citrine	CERN	OK up-to-date	n/a	Stalled at the CERN PPS. Version not yet stable. Details in https://its.cern.ch/jira/browse/MWREADY-81
FTS3	3.3.3	CERN	OK up-to-date	n/a	new version 3.4.0 to be tested soon
ARC-CE	5.0.3	Brunel	OK up-to-date	n/a	Verification completed as per https://its.cern.ch/jira/browse/MWREADY-84

WLCG MW Readiness Software Status

• MW readiness App v.0.3 deployed in prod. Volunteer sites managers can now access information about the packages installed at their sites and published via pakiti:
  • https://wlcg-mw-readiness.cern.ch/sites/ ( certificate is needed )
  • the app tries to map the information on the packages with the Products present in his KB.
  • Feedback is welcome
• Pakiti packaging for Debian is ongoing

Sites' feedback

• PIC report:
  • Pre-production storage using dCache 2.13.13
    • moving to test 2.14 in the coming weeks.
  • Phedex transfers:
    • using PhEDEx 4.1.7, with agents configured to use FTS3 pilot at CERN
    • links: PIC->CERN not working, PIC->GRIF_LLR with intermittent failures in the last days.
    • links: GRIF_LLR -> PIC, CERN -> PIC basically working OK for the last weeks (sporadic errors)
  • HC test jobs continue running fine
  • WAN data access via xrootd is functional again. Port assignment misconfiguration (blocking xrootd WAN access at firewall level) has been solved
  • Enabling IPv6 at the srm-pps and disk pool for testing, as a request from CMS (A. Sciaba)

• CNAF
• Napoli
• Edinburgh
• QMUL
• Brunel
• CERN
• ... other sites

Report from the ARGUS meeting

• The ARGUS Collaboration met on Nov. 6th: agenda, minutes
• The next ARGUS Collaboration meeting was today, December 2nd: agenda, minutes
• The MW Readiness related activity is monitored via https://its.cern.ch/jira/browse/MWREADY-30. Its new due date is 15 February 2016.

Actions

Action items Done from past meetings can be found HERE.

• 20150506-03: NDGF to install the pakiti client. Updated instructions here. Done the day after last meeting, i.e. 29/10. As NDGF run on ubuntu, Lionel offered to make a version for that OS and put instructions in the manual on where to find it.
• 20150318-02: Ben to set-up the ARGUS testbed at the T0. The testbed is there, the load testing is in the list but Postponed
• 20141119-03: Andrea M. to contact the GRIF site to proceed with WN testing via the CMS workflow POSTPONED

Next meeting

• Suggested date is JANUARY 20TH 2016 AT 16HRS CET

AOB

-- MariaDimou - 2015-11-24