Apologies: Pepe Salt
Present: Andres Pacheco (IFAE), Javier Lopez (CESGA), Jose R. Valverde (CNB), Celso Martinez Rivero (IFCA), Javier Palacios (IFIC), Adria Casajus (UB), Pablo Rey (CESGA), Gonzalo Merino (PIC), Carlos Borrego (PIC), Javier Sanchez (IFIC), Daniel Cano (IFIC), Guillermo Losilla (BIFI), Marc Rodriguez (PIC), Mario David (LIP), Alejandro Lamas Davina (IFIC), Javier Fontan (CESGA), Alvaro Fernandez Casani (IFIC), Kai Neuffer (INTA-CAB), Mohammed Kaci (IFIC)
12:00
→
12:15
Briefing of activities15mVRVS
VRVS
Speaker:
Pacheco, Andreu(IFAE)
more information
12:05
→
12:15
Operational status from sites10mVRVS
VRVS
* From February 1st 2005 all sites must report by mail their operational status each friday if they want Gonzalo Merino to report with accuracy their status to EGEE Operations Meeting
* Since the people from CERN is asking the ROCs to write the monday's 11 report following a sort of template, I think it will be useful that the SWE Site Reports that site managers are sending on friday to this list, try to follow a similar template as well. I suggest then that these reports are produced following the template available at:
https://services2.pic.org.es/devel/download/txt/SR-SWE-Template.txt
* Reports should be sent to: egee.swe.roc.contact@pic.es
The reports from SWE are appended to the agenda page of the weekly operation meetings:
http://agenda.cern.ch/displayLevel.php?fid=258
Speaker:
Merino, Gonzalo(PIC)
BIFI-LCG15m
Weekly Operations Status Report: BIFI
Reporting Period: 10/10/2005 to 14/10/2005
Availability of Core Services Hosted in the Site
==================================================
No core services running at BIFI
Non-Functional Time
====================
Several SFTs run by GOC failed along the reporting period:
[CT] 2005-10-10 09:05:45
[CT] 2005-10-10 12:05:33
[CT] 2005-10-10 18:05:11
[CT] 2005-10-11 00:05:54
[CT] 2005-10-14 10:50:01
All of them failed in the replica management tests; it seems to be the a new episode of the infamous random failures at the SFTs.
Scheduled Down Time
===================
No scheduled down time intervals during the reporting period nor expected in the coming days.
Major Operational Issues Encountered During the Reporting Period
================================================================
none
Upgrade to Scientific Linux 3 (or equivalent)
=============================================
By when will all service nodes in the Site be upgraded? Already done (running SL 3.0.4)
By when will the WNs in the Site be upgraded? Already done (running SL 3.0.4)
Points to Raise at the Operations Meeting
=========================================
none
Speaker:
Losilla Anadon, Guillermo(BIFI)
CESGA-EGEE15m
Speaker:
Lopez, Javier(CESGA)
CIEMAT-LCG215m
Weekly Operations Status Report: CIEMAT-LCG2
Reporting Period: 07/10/05 to 14/10/05
Availability of Core Services Hosted in the Site ==================================================
There is no core services running at CIEMAT at this moment
Non-Functional Time
====================
None
Scheduled Down Time
===================
* Scheduled Maintenance During the Reporting Period 0
* Scheduled Maintenance During the Next Reporting Period 0
Major Operational Issues Encountered During the Reporting Period ================================================================
None
Upgrade to LCG 2.6.0
====================
Still pending due to SC3
Points to Raise at the Operations Meeting =========================================
None
Speaker:
Calonge, Javier (+34913466000 Ext: 6802)(CIEMAT)
CNB-LCG215m
* Jose R. Valverde reporting.
* Expected everything working in a couple of days.
Speaker:
David Garcia Aristegui(CNB)
IFCA-LCG215m
* Dani Cano reporting.
* Since Saturday having some replica manager errors. Reconfiguration of all nodes to publish more accurate value of Spec Int.
Speaker:
Cano, Dani(IFCA)
IFIC-LCG215m
* Javi Sanchez reporting.
* Quattor installed nodes failed. In quattor only one dns was configured. When this dns failed the services were disrupted. Now solved.
-- Weekly Operations Status Report: IFIC-LCG2
Reporting Period: 10/10/2005 to 17/10/2005
Availability of Core Services Hosted in the Site
RB: lcg2rb.ific.uv.es (public use) [OK]
RB: lcg2rb2.ific.uv.es (ATLAS production) [OK]
BDII: lcg2bdii.ific.uv.es (test zone) [OK]
BDII: isn04.ific.iv.es (ATLAS production) [OK]
PROX: lcg2proxy.ific.uv.es [OK]
Non-Functional Time
Saturday, 15th October 2005 from 02:00 to 12:00 aprox. due to DNS failure at University computer center.
Scheduled Down Time
* Scheduled Maintenance During the Reporting Period None
* Scheduled Maintenance During the Next Reporting Period None
Major Operational Issues Encountered During the Reporting Period
SFT tests cotinue to fail randomly on APEL test.
Speaker:
Sanchez, Javier(IFIC)
INTA-CAB15m
* Kai Neuffer reporting.
* nfs-mounted disk failure caused service disturbance.
Weekly Operations Status Report: INTA-CAB
Reporting Period: 10/09/05 to 14/09/05
Availability of Core Services Hosted in the Site
================================================
No core services hosted in this site.
Non-Functional Time
===================
0 days.
Scheduled Down Time
===================
* Scheduled Maintenance During the Reporting Period
0 days
* Scheduled Maintenance During the Next Reporting Period
0 days.
Major Operational Issues Encountered During the Reporting Period
================================================================
None.
Upgrade to Scientific Linux 3 (or equivalent)
=============================================
Already done.
Points to Raise at the Operations Meeting
=========================================
None.
Speaker:
Neuffer, Kai(INTA)
LIP-LCG215m
* Mario David reporting.
Weekly Operations Status Report: LIP
Reporting Period: 03/10/05 to 09/10/05
Availability of Core Services Hosted in the Site ==================================================
RB: rb02.lip.pt
PX: px01.lip.pt
BDII: ii02.lip.pt (machines with problems) taken out of the
GOC DB it will be substituted. We will keep the ii03 as production BDII
BDII: ii03.lip.pt
LFC: lfc01.lip.pt
Non-Functional Time
====================
Three random Replica Management failures during the whole week
Points to Raise at the Operations Meeting
=========================================
Scheduled Down Time
===================
Major Operational Issues Encountered During the Reporting Period
================================================================
The test BDII (ii03.lip.pt) passes now to production since the ii02 has
serious problems, it will be deprecated for now, it was taken out of the
GOCDB.
We are presently draining the atlas and cms queues, but will not put a
Scheduled Downtime, since site will continue operational for the other
VO's. This is needed to apply maui policies which are not being
"respected".
Speaker:
David, Mario(LIP)
IFAE15m
* Carlos reporting.
Weekly Operations Status Report: [ IFAE ]
Reporting Period: [ 10/10/05 ] to [ 17/10/05 ]
Availability of Core Services Hosted in the Site ==================================================
RB, BDII: ifaece02.ifae.es [OK]
Non-Functional Time
====================
- Total days unavailable: 0 days
Scheduled Down Time
===================
Major Operational Issues Encountered During the ReportingB Period ================================================================
none
Upgrade to Scientific Linux 3 (or equivalent) =============================================
By when will all service nodes in the Site be upgraded? done
By when will the WNs in the Site be upgraded? done
Points to Raise at the Operations Meeting =========================================
none
Speaker:
Borrego, Carlos(PIC)
PIC15m
* Carlos Borrego reporting.
* Problem in Friday with jobs in MAUI. Reservations with the computer element failing.
Weekly Operations Status Report: [ PIC ]
Reporting Period: [ 10/10/05 ] to [ 17/10/05 ]
Availability of Core Services Hosted in the Site ==================================================
ce01.ifae.es bdii01.pic.es [OK]
Non-Functional Time
====================
- Total days unavailable: 0
Scheduled Down Time
===================
Major Operational Issues Encountered During the Reporting Period ================================================================
- ACSLS server down twice.
- problem on friday with maui reservations. we were forced to kill one lhcb job. at the moment it seems stable
Upgrade to Scientific Linux 3 (or equivalent) =============================================
By when will all service nodes in the Site be upgraded? Done
By when will the WNs in the Site be upgraded? Done
Points to Raise at the Operations Meeting =========================================
none
Speaker:
Borrego, Carlos(PIC)
UAM-LCG215m
Weekly Operations Status Report: [ UAM-LCG2 ]
Reporting Period: [ 10/10/05 ] to [ 17/10/05 ]
Availability of Core Services Hosted in the Site ==================================================
VOServer [OK]
RB [OK]
BDII [OK]
Non-Functional Time
====================
SFT
_____
JL --> 2005-10-12 18:05:18 to 2005-10-13 06:05:55
Error:
CE was offline
Scheduled Down Time
===================
Major Operational Issues Encountered During the Reporting Period
================================================================
none
Upgrade to Scientific Linux 3 (or equivalent)
=============================================
By when will all service nodes in the Site be upgraded? []
Points to Raise at the Operations Meeting
=========================================
none
Speaker:
Pardo Navarro, Juan Jose(UAM)
UB-LCG215m
* Adrian Casajus reporting.
* Firewall problem at the UB.
Weekly Operations Status Report: UB
Reporting Period: 10/10/2005 to 16/10/2005
Availability of Core Services Hosted in the Site ================================================
Non Core Service in the Site
Non-Functional Time
====================
None
Scheduled Down Time
===================
None
Major Operational Issues Encountered During the Reporting Period ================================================================
None
Points to Raise at the Operations Meeting =========================================
None
Speaker:
Graciani, Ricardo and Casajus, Adrian(UB)
UPV-GRyCAP15m
* Reported by mail.
* The issue is that they are at LCG 2.4 and no plans foreseen.
Weekly Operations Status Report: [ UPV-GRyCAP ]
Reporting Period: [ 10/10/05 ] to [ 14/10/05 ]
Availability of Core Services Hosted in the Site
==================================================
RB, BDII: apis.dsic.upv.es -> 0 days
Non-Functional Time
====================
- Total days unavailable: 0
Scheduled Down Time
===================
* Scheduled Maintenance During the Reporting Period
- Total days unavailable 0
* Scheduled Maintenance During the Next Reporting Period
- Estimated number of days for which the site will be unavailable 0 days
Major Operational Issues Encountered During the Reporting Period
================================================================
none
Upgrade to Scientific Linux 3 (or equivalent)
=============================================
By when will all service nodes in the Site be upgraded? Already done (SL 3.0.4 & FC2)
By when will the WNs in the Site be upgraded? Already done (FC2)
Points to Raise at the Operations Meeting
=========================================
none
Speaker:
Caballer, Miguel (tel. +34 963877007 ext 88254)(GRyCAP-ITACA (UPV))
USC-LCG215m
Weekly Operations Status Report: [ USC-LCG2 ]
Reporting Period: [ 08/09/2005 ] to [ 14/10/2005 ]
Availability of Core Services Hosted in the Site ==================================================
No Core Service Hosted.
Non-Functional Time
====================
None
Scheduled Down Time
===================
* Scheduled Maintenance During the Reporting Period
4 days
* Scheduled Maintenance During the Next Reporting Period
No sched. mant. expected.
Major Operational Issues Encountered During the Reporting Period ================================================================
None
Upgrade to Scientific Linux 3 (or equivalent) =============================================
By when will all service nodes in the Site be upgraded? [ already done ]
By when will the WNs in the Site be upgraded? [ already done ]
Points to Raise at the Operations Meeting =========================================
None.
Speaker:
Saborido, Juan Jose
12:10
→
12:15
APEL Status Report5mVRVS
VRVS
APEL STATUS REPORT
== Period ==
From October 8 to October 14
== Summary ==
During this week, the Flexible Archiver has been down several days
(13 and 14). This avoids publishing accounting data properly even if Apel is working fine in some sites.
After this week this is the status of the federation related to accounting:
* 12 sites have published their accounting data properly.
* 1 site is in Scheduled Maintenance
* 1 site is not publishing their accounting since 04/08/05
Regarding the CPU normalization test, in the web page http://mon.egee.cesga.es/sft/lastreport.cgi you can view the results of the test (take into account that this test is under development). The status at this moment is the following:
* 8 sites have setup the cputmult factor properly
* 4 sites should check the cputmult factor
* 1 site has problems with the BDII, so the test has failed (0%)
* 1 site is in Scheduled Maintenance
There are some sites which don't have updated to LCG 2.6.0. If you need, in http://www.egee.cesga.es/EGEE-SA1-SWE/accounting/guides/ApelInstallationNotesForYaim/apel-yaim.html
you can found information about the configuration of Apel in LCG 2.6.0.
== Status of each SWE site ==
Site: BIFI
Solved Problems of Last Report: Yes
Missing Accounting Entries: Since 13/10/05 to 14/10/05
Publishing User Name Information: Yes
Actions: Check the Apel logs
Other Comments: Probably they don't have published data due to a R-GMA Server problem
Site: CESGA
Solved Problems of Last Report: Yes
Missing Accounting Entries: 14/10/05
Publishing User Name Information: Yes
Actions: Check the Apel logs
Other Comments: Probably they don't have published data due to a R-GMA Server problem
Site: CIEMAT
Solved Problems of Last Report: Yes
Missing Accounting Entries: 14/10/05
Publishing User Name Information: Yes. They have published some old records without this information
Actions: Check the Apel logs
Other Comments: Probably they don't have published data due to a R-GMA Server problem
Site: CNB
Solved Problems of Last Report: NO
Missing Accounting Entries: Since 06/08/05
Publishing User Name Information: NO. Since 30/07/05 they are no publishing this information
Actions: None
Other Comments: They are updating to LCG 2.6.0
Site: ifae
Solved Problems of Last Report: Yes
Missing Accounting Entries: Since 13/10/05 to 14/10/05
Publishing User Name Information: Yes. They have published some old records without this information
Actions: Check the Apel logs
Other Comments: Probably they don't have published data due to a R-GMA Server problem
Site: IFCA
Solved Problems of Last Report: NO
Missing Accounting Entries: Since 04/08/05
Publishing User Name Information: Yes
Actions: They should check the Apel log files
Other Comments: They have updated to LCG 2.6.0 and they are having problems with the connection to the accounting database in the MON
Site: IFIC
Solved Problems of Last Report: Yes
Missing Accounting Entries: 14/10/05
Publishing User Name Information: Yes
Actions: Check the Apel logs
Other Comments: Probably they don't have published data due to a R-GMA Server problem
Site: INTA
Solved Problems of Last Report: Yes
Missing Accounting Entries: Since 13/10/05 to 14/10/05
Publishing User Name Information: Yes
Actions: Check the Apel logs
Other Comments: Probably they don't have published data due to a R-GMA Server problem
Site: LIP
Solved Problems of Last Report: Yes
Missing Accounting Entries: Since 13/10/05 to 14/10/05
Publishing User Name Information: None
Actions: Check the Apel logs
Other Comments: Probably they don't have published data due to a R-GMA Server problem
Site: pic
Solved Problems of Last Report: Yes
Missing Accounting Entries: Since 13/10/05 to 14/10/05
Publishing User Name Information: Yes
Actions: Check the Apel logs
Other Comments: Probably they don't have published data due to a R-GMA Server problem
Site: UAM
Solved Problems of Last Report: Yes
Missing Accounting Entries: Since 13/10/05 to 14/10/05
Publishing User Name Information: Yes
Actions: Check the Apel logs
Other Comments: Probably they don't have published data due to a R-GMA Server problem
Site: UB
Solved Problems of Last Report: Yes
Missing Accounting Entries: 14/10/05
Publishing User Name Information: Yes. They have published some old records without this information
Actions: Check the Apel logs
Other Comments: Probably they don't have published data due to a R-GMA Server problem
Site: UPV
Solved Problems of Last Report: Yes
Missing Accounting Entries: 14/10/05
Publishing User Name Information: Yes
Actions: Check the Apel logs
Other Comments: Probably they don't have published data due to a R-GMA Server problem
Site: USC
Solved Problems of Last Report: Yes
Missing Accounting Entries: 14/10/05
Publishing User Name Information: NO. Since 13/10/05 they are no publishing this information
Actions: Check the Apel logs and the Apel configuration
Other Comments: Probably they don't have published data due to a R-GMA Server problem
== Accounting Support ==
Accounting Web Page: http://www.egee.cesga.es/EGEE-SA1-SWE/accounting/
Accounting FAQ: http://www.egee.cesga.es/EGEE-SA1-SWE/accounting/faq.html
Accounting Statistics:
http://www.egee.cesga.es/EGEE-SA1-SWE/accounting/reports/
CPU Normalization:
http://www.egee.cesga.es/EGEE-SA1-SWE/accounting/normalization.html
Accounting Guides: http://www.egee.cesga.es/EGEE-SA1-SWE/accounting/guides/
Contact e-mail: egee-admin@cesga.es
Speaker:
Rey Mayo, Pablo(CESGA)
12:15
→
12:30
Action lists15mVRVS
VRVS
Speaker:
Pacheco, Andreu(IFAE)
5.3.7.4 Mario to deploy gmdat monitoring tools in SWE (OPEN)15m
Sites which have deployed the sensor and are OK CESGA IFAE IFCA IFIC LIP PIC
Sites which the sensors are not working presently but had deployed the tool BIFI UPV
Sites which have not yet deployed, and should do so (come on, it only takes 5 minutes, if not tell me I am wrong) 'CIEMAT' => 'lcg02.ciemat.es', 'CNB' => 'mallarme.cnb.uam.es', 'INTA' => 'ce00.inta.es', 'UAM' => 'grid003.ft.uam.es', 'UB' => 'lcg-ce.ecm.ub.es', 'UCM' => 'DUMMYCE.ucm.es', 'USC' => 'lcg-ce.usc.cesga.es'
go to
http://grid-mon.lip.pt/grid-mon/index.php
and in case of doubts send me mail
Speaker:
David, Mario(LIP)
5.9.19.1 All sites to upgrade the gridice sensor in all machines15m
hay 3 sitios más que han actualizado el gridice sensor: CIEMAT, UAM, UB.
La lista quedaría así:
- Actualizados: BIFI, CESGA, CIEMAT, CNB, IFAE, LIP, PIC, UAM, UB, UPV, IFCA, IFIC, INTA
- No actualizados: USC
Speaker:
Francisco Jose Bernabe Pellicer(CESGA)
5.9.19.2 All sites to upgrade fmon2glue in gridice collector (NEW)15m
Speaker:
Francisco Jose Bernabe Pellicer(CESGA)
5.9.19.3 Request for volunteers to test network monitoring with GridICE (NEW)15m
Speaker:
Francisco Jose Bernabe Pellicer(CESGA)
5.9.19.4 All sites to feedback about GridICE e-mails (NEW)15m
Speaker:
Francisco Jose Bernabe Pellicer(CESGA)
12:20
→
12:35
Preproduction Activity Status15mVRVS
VRVS
This section will contain an update about the preproduction activity in SWE where more and more sites will be involved.
Speaker:
Pacheco, Andreu(IFAE)
PIC Report15m
* Carlos Borrego reporting.
* Nick is asking who is going to Niza and he will request 1-2 slides per site.
Speaker:
Carlos Borrego(PIC)
CESGA15m
* Fco. Bernabe reporting.
* Working in small configuration files (splitting) for easy upgrade.
Speaker:
Lopez, Javier(CESGA)
IFIC15m
* Alvaro Fernandez Casani.
* No major changes.
* Testing the FTS service.
Speaker:
Fernandez Casani, Alvaro(IFIC)
LIP15m
* Gonzalo Reporting.
* Some error launching DAG jobs on the condor queue.
* Antonio Retico requested to deploy gLite 1.4. Should we put effort in a common configuration file?
* The certification team tested gLite first. Asking to them the configuration files would be a good start.
Speaker:
David, Mario(LIP)
INTA-CAB15m
* Kai Neuffer.
* No news. Mauro Lopez on vacation.