Operations team & Sites

Tuesday 21 May 2019, 11:00 → 12:30 Europe/London

EVO - GridPP Operations team meeting

- This is the weekly GridPP ops & sites meeting

- The intention is to run the meeting in VidyoConnect: https://vidyoportal.cern.ch/flex.html?roomdirect.html&key=zXhsqAxVnaT6

-- The PIN is 1234. To join via phone see http://information-technology.web.cern.ch/services/fe/howto/users-join-vidyo-meeting-phone.

-- The London (UK) service is on +442030510622.

-- The meeting extension is 109308582. PIN 1234

Chair:  Matt

Minutes:

Apologies:

Meeting minutes OPS and sites 21/05/19

Attendess:

Andrew Mcnab

Brian Davies

Chris Brew

Dan Traynor

Daniela Bauer

Darren Moore

Davidv crooks

Emanuele

Gareth Roy

Gordon Stewart

John Hill

Kashif Mohammad

Mark Slater

Matt Doidge

Winnie Lacesco

Raja Nandakumar

Rob Currie

sam skipsey

Steve Jones

Teng Li

Vip

Review of weekly issues by experiment/VO

    LHCb

T2  ok running

T1 problem opening file on ECHO

    CMS

Lots of jobs running due to no HLT

Bristol ticket: high load on SE.

T1 https://cms-site-readiness.web.cern.ch/cms-site-readiness/SiteReadiness/HTML/SiteReadinessReport.html#T1_UK_RAL

T2: https://cms-site-readiness.web.cern.ch/cms-site-readiness/SiteReadiness/HTML/SiteReadinessReport.html#T2_UK_London_Brunel

ATLAS

No representation

Other: Updates should be recorded in https://www.gridpp.ac.uk/wiki/GridPP_VO_Incubator.

From DB:

*T2K (LFC to DFC): We are almost done, but someone needs to rescue Elena who ran into a DPM snafu.

*MICE (LFC to DFC): Mice is still deliberating of what to do with their tape data.

GridPP DIRAC status [Andrew McNab]

Snoplus also informed of LFC going away

-- https://www.gridpp.ac.uk/gridpp-dirac-sam

LZ in push for kick off. so probably lots of jobs

cvmfs timeout for squid at Glasgow for  t2k jobs( size limit on objects (1G)on squid the issue possibly?)

AM:No cache limit in vac but CVMFS settings maybe . CVMFS_QUOTA_LIMIT CVMFS_NFILES

--------------------------------------------------------------------------------------------------------------

With reference to: http://www.gridpp.ac.uk/wiki/Operations_Bulletin_Latest

--General updates

Ping GR of any meeting you thing Jeremey Coles would have attended

HEPSYMAN this week

*WLCG co-ordination meeting last week , no one attended

**Cream migration workshop

***New EOL cream mailing list

**DPM upgrade talk

***lcd-dm support end 1/6/19

***KM-Oxford upgrading DOME, question regarding quota tokens, since not adding new VOs, can I just convert Space token to quota token?

***SS-New quotatoken for any space which can be written into

*** DPM workshop next month MD attending remotely

****UK position needs clarifying

 -- WLCG ops coordination

--Tier-1 status

Border Router upgrade tommorrow

--Interoperation

10/6 next meeting EGI ops

--On-duty

KM on duty

--Rollout

BD ask ipv6 and storage status kept up to date

--Security

DC gave update

Training session at HEPSYSMAN

--Services

Latency perfSONAR Issue for Lancaster and Glasgow

--Tickets

RHUL ticket stuck in assign state

Manchester ticket stuck in assign state

---------------------------------------------------------------------------------

Discussion topics

DB-Dirac workshop had direct interaction with users

https://indico.cern.ch/event/756635/timetable/#20190514

 

11:00 → 11:01 Ops meeting minutes

• This is a reminder that this is an important task. The minute taker gives access to the discussions for those not present and provides a reference for others to refer back to afterwards.

• The team composition has been changing. If everybody contributes then the task comes around less often.

• Please extract actions from the meeting and add them to our table here: https://www.gridpp.ac.uk/wiki/Operations_Team_Action_items#Action_list.

• Recent allocations: See above link. The page should be updated each week by the minute taker (if they don't the task will keep coming to them!).

• Upcoming allocations:

11:01 → 11:20 Experiment problems/issues

Review of weekly issues by experiment/VO

• LHCb

• CMS
  T1: https://cms-site-readiness.web.cern.ch/cms-site-readiness/SiteReadiness/HTML/SiteReadinessReport.html#T1_UK_RAL
  T2: https://cms-site-readiness.web.cern.ch/cms-site-readiness/SiteReadiness/HTML/SiteReadinessReport.html#T2_UK_London_Brunel

• ATLAS

• Other: Updates should be recorded in https://www.gridpp.ac.uk/wiki/GridPP_VO_Incubator.

Also from Daniela:
*T2K (LFC to DFC): We are almost done, but someone needs to rescue Elena who ran into a DPM snafu.

*MICE (LFC to DFC): Mice is still deliberating of what to do with their tape data.

• GridPP DIRAC status [Andrew McNab]
  -- https://www.gridpp.ac.uk/gridpp-dirac-sam

11:20 → 11:40 Meetings & updates

With reference to: http://www.gridpp.ac.uk/wiki/Operations_Bulletin_Latest

• General updates
• WLCG ops coordination
• Tier-1 status
• Storage and data management
• Tier-2 Evolution
• Accounting
• Documentation
• Interoperation
• Monitoring
• On-duty
• Security
• Services
• Tickets
• Tools
• VOs
• Site updates

11:40 → 12:20 Discussion topics

• February GDB: https://indico.cern.ch/event/739875/
• Site roundtable.

12:20 → 12:25 Actions & AOB