Operations team & Sites

→ Europe/London
EVO - GridPP Operations team meeting

EVO - GridPP Operations team meeting

Description

- This is the weekly GridPP ops & sites meeting - The intention is to run the meeting in Vidyo: https://vidyoportal.cern.ch/flex.html?roomdirect.html&key=zXhsqAxVnaT6 -- The PIN is 1234. To join via phone see http://information-technology.web.cern.ch/services/fe/howto/users-join-vidyo-meeting-phone for dial in numbers. -- The London (UK) service is on +44 (0)161 306 6802. Phone bridge ID 1001002 -- The meeting extension is 109308582. PIN 1234 Chair: Jeremy Minutes: Raul Reserve:  Apologies:

* LHCB
 
   No report

 


* CMS

D. Bauer

Problems commissioning Singularity nodes at IC. All jobs failing. CMS too slow to debug.


* Atlas

E.  Korolkova:

- Problem with disk space in QMUL. Email sent by Brian.
- Long standing ticket with ECDF. Last 4h no errors. Last 24h errors with pool
  reporting full.
- Atlas report: Atlas wants small sites to run with CPU-only. Some German
  sites already like that. Birmingham, Sheffield and Cambridge in test.

A Forti:
 Atlas pushing harder on non-disk sites.
 Three UK sites are forced to upgrade DPM even if they are to become diskless.
 
Sam: Only advantage in upgrading to DPM 1.9 is to get distibuted management
functions.

* non-LHC VOs

J Coles: information on incubators is outdated.

**Dirac

B Davies:
 Transfers from Edninburgh at 2TB a day
 RAL setup ready for transfers from all sites.

** Euclide

 J Coles:
  Status page is outdated.
 A Lahiff:
  Setup ready.
  Waiting for Euclide community to act.
 
** GalDyn
 Matt Doidge: loosing momentum

** Ligo
 A Lahiff: OSG has been enabled in the RAL batch system. Waiting for
 jobs.
 Sam: dataset is very small.
 
** Lofar
 No report since March.
 Very slow progress.

** LSST

 A Forti:
  Starting to test again.
  Running basic jobs in Lancaster and Manchester.
  A Forti to ask Daniela to test the storage: writing with the pilot role.
  Possible problem with RAL.
  There are some sort of Nagios tests through Dirac, but not clear what they
  do.

** LZ
 E. Korolkova:
  Plan to start data challenge next week.
  Looking at 70 TB of data.
  Data to be generated at UK datacentre and then to be moved to US for
  analysis.
  Short jobs of up to 2GB RAM.
  Sites? Brunel, IC, Lancaster, RHUL, Liverpool.

** Dune

 E. Korolkova:
  Request to submit jobs from Fermi lab.
 D Bauer:
  Single core jobs.
  Glexec failures.
  Not many jobs, but it should be ok.
 
** Pravda
 Waiting on data processing.

** SKA
 No report.

** snoplus
 P Gronbech:
  EMailed snoplus. Will send update

** T2K
 J Coles:  Activity last year
 D Trayner: active again
   Collaboration meeting this week
   Migration to dirac/gfal

** Pheno
 Very active.
 Durham usage on increase

** ILC
 No contact
 Lots of activity?  J Coles to provide numbers.

** Cernatschool
 Some recent activity in UK.

** Fermilab
 M Doidge: Fermilab represented by Microbone
  Running 8 core jobs at Lancaster
  Lots of activity since March.


** GridPP VO
 
- MICE:
 J Coles:
  Januzs doing Mice testing of Dirac.

- ICECUBE
 Some activity in the NorthGrid VO.

 A Forti: two users in the Northgrid VO.

* Dirac status
 D.Bauer: waiting for update for SL7

* Bulletin
  http://www.gridpp.ac.uk/wiki/Operations_Bulletin_Latest

  Issue with Moedal moving data depending on server issuing proxy


** Issue with certificate emission
 - Request from JK: email certificate issues to grid-support

** EGI broadcast: issues with latest CREAMCE release

** Dcache issues when upgrading
   
* T1 status

- No  major issues

* Security
 Intel AMT vulnerability

* Ticket

R Lopes: Brunel xroot problem related to DPM library.


* WLCG minutes update

https://twiki.cern.ch/twiki/bin/view/LCG/WLCGOpsMinutes170518

Main issue affecting UK sites: patching of ARC-CE

https://indico.cern.ch/event/639351/contributions/2597260/attachments/1462345/2259108/fzk_arc_ce_woc.pdf

 

 

There are minutes attached to this event. Show them.
    • 11:00 → 11:01
      Ops meeting minutes 1m
      • This is a reminder that this is an important task. The minute taker gives access to the discussions for those not present and provides a reference for others to refer back to afterwards.

      • The team composition has been changing. If everybody contributes then the task comes around less often.

      • Please extract actions from the meeting and add them to our table here: https://www.gridpp.ac.uk/wiki/Operations_Team_Action_items#Action_list.

      • Recent allocations: See above link. The page should be updated each week by the minute taker (if they don't the task will keep coming to them!).

      • Upcoming allocations:

      23rd May: Raul
      30th May:
      6th June:

    • 11:01 → 11:20
      Experiment problems/issues 19m

      Review of weekly issues by experiment/VO

      • LHCb

      • CMS
        https://cms-site-readiness.web.cern.ch/cms-site-readiness/SiteReadiness/HTML/SiteReadinessReport.html#T2_UK_London_Brunel

      • ATLAS

      • Other: Updates should be recorded in https://www.gridpp.ac.uk/wiki/GridPP_VO_Incubator.

      • GridPP DIRAC status [Andrew McNab]
        -- https://www.gridpp.ac.uk/gridpp-dirac-sam

    • 11:20 → 11:40
      Meetings & updates 20m

      With reference to: http://www.gridpp.ac.uk/wiki/Operations_Bulletin_Latest

      • General updates
      • WLCG ops coordination
      • Tier-1 status
      • Storage and data management
      • Tier-2 Evolution
      • Accounting
      • Documentation
      • Interoperation
      • Monitoring
      • On-duty
      • Security
      • Services
      • Tickets
      • Tools
      • VOs
      • Site updates
    • 11:40 → 12:20
      Updates 40m
      • WLCG ops coordination (theme providing reliable storage)
        ** Agenda https://indico.cern.ch/event/639351/
        ** Minutes https://twiki.cern.ch/twiki/bin/view/LCG/WLCGOpsMinutes170518
    • 12:20 → 12:25
      Actions & AOB 5m
      • https://www.gridpp.ac.uk/wiki/Operations_Team_Action_items