Choose timezone
Your profile timezone:
Operations Meeting
→
Europe/Zurich
CERN
CERN
Description
Phone: +41 22 767 7000 \"Grid Operations/Ian Bird\"
Weekly Operations' Meeting 2005-04-25
Agenda: http://agenda.cern.ch/fullAgenda.php?ida=a045864
Operations' Manual: http://lcgdeploy.cvs.cern.ch/cgi-bin/lcgdeploy.cgi/lcg-docs/EGEE-CIC-Operational-Manual/opMan.pdf
CA rpm instructions: http://cern.ch/grid-deployment/lcg2CAlist.html and https://cic.in2p3.fr/index.php?id=rc&subid=rc_config
Template for weekly report submission by the ROC: http://cern.ch/egee-docs/list.php?dir=.\operational_tools\&
Participants:
Asia Pac.:
CE: Marcin Radecki
CERN: Maria Dimou (Secretary), Ian Neilson, Piotr Nyczyk, Nick Thackray (chair)
CH/DE: Sven Hermann
FR: David Bouvet, Pierre Girard
IT:
NE: Per Öster, Jules Wolfrat
SEE: Kostas Koumantaros, Ognjen Prnjat
SWE: Carlos Borrego (PIC), Andreu Pacheco
Russia:
UK/IR: Philippa Strange
Apologies:
Absences: Nobody joined from Italy (Support-on-Duty) and Russia (CIC-on-Duty).
Comments on the notes of the last meeting:
This was not discussed. Maria mentioned Rod Walker's email complaining the operational problems that Atlas faced were not mentioned at the last meeting and they should have. support-eis@cern.ch members, invited to this meeting, should come more often to relay experiment problems for discussion. Problem submission between meetings should go to http://ggus.org
Date: Wed, 13 Apr 2005 19:57:24 -0700 (PDT)
From: Rod Walker
To: Maria.Dimou@cern.ch
Cc: project-egee-roc-managers@cern.ch, edward@bnl.gov,
lcg_support@triumf.ca, lcg-admin@fnal.gov,
lcg-manager@grid.sinica.edu.tw,
project-eu-egee-cic-managers ,
Ian Neilson
Subject: Re: Notes and actions from the 2005-04-11 Weekly Operations Meeting
Hi,
From the point of view of Atlas Production last week had several major
problems on LCG, none of which were mentioned in the minutes of the
meeting. I`m certainly not pointing any fingers, since I might implicate
myself, but there is clearly a communication problem. For example, Sinica
SE files were unavailable for 2 days because they turned off the
information service in order to drain the queues before an upgrade. This
exchange happened on Rollout, and it was corrected to just disabling the
queues, not the site information.
There were continuing teras problems and a problem at ific that the
castorgrid SE was removed from the information (the srm one was still
there).
Smaller problems of various missing NFS mounts for experiment areas and a
type in the mount at RAL were sorted by direct contact to the sites
concerned. The larger problems went throught the rollout list. This may
not be the correct procedure but it get`s results. I`ve tried cic-on-duty
mails in the past but the list permissions bounced my mails. I have been
told to use the broadcast and I guess I`ll try this again. Will this
ensure the major problems get a mention at the Ops meeting?
Cheers,
Rod.
CIC & ROC reports:
Exiting CIC-on-duty (CERN):
A full report is in the CIC-on-duty log, starting as [2005-04-25 12:46] - Judit Novak
ROC reports must be uploaded to this meeting's agenda as "More Information" by the CIC-on-duty and the ROC managers themselves by 11am CET. The report template, is linked from the ROC views of the CIC web site. NB! New template!!
Osman Aidel is making a new web form for the weekly report, reachable as https://egee.in2p3.fr/CIC/index.php?id=roc&js_status=2&roc_page=rc1&roc_page=1 It won't be finalised before May 9th, so please submit comments about it to:
- Gilles Mathieu <Gilles.Mathieu@in2p3.fr>
- Osman AIDEL <oaidel@cc.in2p3.fr>
Issues discussed in addition:
The CA rpms, (EUGridPMA 0.28) valid since April 6th, 2005, are not updated at all sites. People should take action a.s.a.p.
The LCG2 2_4_0 upgrade is progressing much too slowly. Markus Schulz produced a status slide HERE. It shows the evolution of the system during the last 76 days. According to our information system we have 136 sites and 50 are on the latest version. The VERY-VERY-VERY old contains all sites that are neither 2.4.0, 2.3.1 or 2.3.0. Note, we have still more than 20 of them (Text by Markus).
Jules reported that a RB was down at NIKHEF for a short-enough time to cause no service disturbance.
Piotr asked all cic-on-duty managers to set the right Reply-To value when they send email to a site to avoid correspondence between individuals
NB! All CICs, please, re-visit the on-duty rotation agenda.
Security report (Ian Neilson):
- Nothing to report.
Next CIC-on-duty:
- The CIC-on-duty this week is Russia.
- The actual work is be done by the ROCs and the follow-up by the CICs. The CIC-on-duty just does the monitoring.
- The ROC managers should remember that when a problem at a site is solved the site needs to go through a period of quarantine before joining production again. This is mentioned in the Operations' Manual.
- The CIC site (requires personal certificate loaded) is http://cic.in2p3.fr .
- Link to the daily Site Status reports.
- Savannah should be used for the Tasks' hand-over and follow-up. The Operations' Manual should be the basis.
- When the CICs report also as ROCs, they should do this in separate reports.
- Sites' status of updates can be checked in the daily reports e.g. http://cern.ch/lcg-testzone-reports/cgi-bin/lastreport.cgi
Action List now in http://cern.ch/dimou/lcg/gdaActions.html
A.O.B.
- Ian Bird gave permission to suspend HPBL (HP Brazil) from the sites' list due to its extended unavailability.
- Now that GGUS is used for tickets on Operations, Philippa will close about 20 out-standing Tasks in savannah.cern.ch
Next meeting:
- The next regular telephone meeting will take place on Monday May 2nd 2005 from 14:00 to 16:00 in conference room 28-R-015.
Maria Dimou, IT/GD, Grid Infrastructure Services
There are minutes attached to this event.
Show them.