EGEE-SA1-SWE Meeting

→ Europe/Zurich
VRVS Virtual Room (http://www.vrvs.org)

VRVS Virtual Room (http://www.vrvs.org)

Pacheco, Andreu
Description
Apologies: Pepe Salt Present: Andres Pacheco (IFAE), Javier Lopez (CESGA), Jose R. Valverde (CNB), Celso Martinez Rivero (IFCA), Javier Palacios (IFIC), Adria Casajus (UB), Pablo Rey (CESGA), Gonzalo Merino (PIC), Carlos Borrego (PIC), Javier Sanchez (IFIC), Daniel Cano (IFIC), Guillermo Losilla (BIFI), Marc Rodriguez (PIC), Mario David (LIP), Alejandro Lamas Davina (IFIC), Javier Fontan (CESGA), Alvaro Fernandez Casani (IFIC), Kai Neuffer (INTA-CAB), Mohammed Kaci (IFIC)
    • 12:00 → 12:15
      Briefing of activities 15m VRVS

      VRVS

      Speaker: Pacheco, Andreu (IFAE)
      more information
    • 12:05 → 12:15
      Operational status from sites 10m VRVS

      VRVS

      * From February 1st 2005 all sites must report by mail their operational status each friday if they want Gonzalo Merino to report with accuracy their status to EGEE Operations Meeting * Since the people from CERN is asking the ROCs to write the monday's 11 report following a sort of template, I think it will be useful that the SWE Site Reports that site managers are sending on friday to this list, try to follow a similar template as well. I suggest then that these reports are produced following the template available at: https://services2.pic.org.es/devel/download/txt/SR-SWE-Template.txt * Reports should be sent to: egee.swe.roc.contact@pic.es The reports from SWE are appended to the agenda page of the weekly operation meetings: http://agenda.cern.ch/displayLevel.php?fid=258
      Speaker: Merino, Gonzalo (PIC)
      • BIFI-LCG 15m
        Weekly Operations Status Report: BIFI Reporting Period: 10/10/2005 to 14/10/2005 Availability of Core Services Hosted in the Site ================================================== No core services running at BIFI Non-Functional Time ==================== Several SFTs run by GOC failed along the reporting period: [CT] 2005-10-10 09:05:45 [CT] 2005-10-10 12:05:33 [CT] 2005-10-10 18:05:11 [CT] 2005-10-11 00:05:54 [CT] 2005-10-14 10:50:01 All of them failed in the replica management tests; it seems to be the a new episode of the infamous random failures at the SFTs. Scheduled Down Time =================== No scheduled down time intervals during the reporting period nor expected in the coming days. Major Operational Issues Encountered During the Reporting Period ================================================================ none Upgrade to Scientific Linux 3 (or equivalent) ============================================= By when will all service nodes in the Site be upgraded? Already done (running SL 3.0.4) By when will the WNs in the Site be upgraded? Already done (running SL 3.0.4) Points to Raise at the Operations Meeting ========================================= none
        Speaker: Losilla Anadon, Guillermo (BIFI)
      • CESGA-EGEE 15m
        Speaker: Lopez, Javier (CESGA)
      • CIEMAT-LCG2 15m
        Weekly Operations Status Report: CIEMAT-LCG2 Reporting Period: 07/10/05 to 14/10/05 Availability of Core Services Hosted in the Site ================================================== There is no core services running at CIEMAT at this moment Non-Functional Time ==================== None Scheduled Down Time =================== * Scheduled Maintenance During the Reporting Period 0 * Scheduled Maintenance During the Next Reporting Period 0 Major Operational Issues Encountered During the Reporting Period ================================================================ None Upgrade to LCG 2.6.0 ==================== Still pending due to SC3 Points to Raise at the Operations Meeting ========================================= None
        Speaker: Calonge, Javier (+34913466000 Ext: 6802) (CIEMAT)
      • CNB-LCG2 15m
        * Jose R. Valverde reporting. * Expected everything working in a couple of days.
        Speaker: David Garcia Aristegui (CNB)
      • IFCA-LCG2 15m
        * Dani Cano reporting. * Since Saturday having some replica manager errors. Reconfiguration of all nodes to publish more accurate value of Spec Int.
        Speaker: Cano, Dani (IFCA)
      • IFIC-LCG2 15m
        * Javi Sanchez reporting. * Quattor installed nodes failed. In quattor only one dns was configured. When this dns failed the services were disrupted. Now solved. -- Weekly Operations Status Report: IFIC-LCG2 Reporting Period: 10/10/2005 to 17/10/2005 Availability of Core Services Hosted in the Site RB: lcg2rb.ific.uv.es (public use) [OK] RB: lcg2rb2.ific.uv.es (ATLAS production) [OK] BDII: lcg2bdii.ific.uv.es (test zone) [OK] BDII: isn04.ific.iv.es (ATLAS production) [OK] PROX: lcg2proxy.ific.uv.es [OK] Non-Functional Time Saturday, 15th October 2005 from 02:00 to 12:00 aprox. due to DNS failure at University computer center. Scheduled Down Time * Scheduled Maintenance During the Reporting Period None * Scheduled Maintenance During the Next Reporting Period None Major Operational Issues Encountered During the Reporting Period SFT tests cotinue to fail randomly on APEL test.
        Speaker: Sanchez, Javier (IFIC)
      • INTA-CAB 15m
        * Kai Neuffer reporting. * nfs-mounted disk failure caused service disturbance. Weekly Operations Status Report: INTA-CAB Reporting Period: 10/09/05 to 14/09/05 Availability of Core Services Hosted in the Site ================================================ No core services hosted in this site. Non-Functional Time =================== 0 days. Scheduled Down Time =================== * Scheduled Maintenance During the Reporting Period 0 days * Scheduled Maintenance During the Next Reporting Period 0 days. Major Operational Issues Encountered During the Reporting Period ================================================================ None. Upgrade to Scientific Linux 3 (or equivalent) ============================================= Already done. Points to Raise at the Operations Meeting ========================================= None.
        Speaker: Neuffer, Kai (INTA)
      • LIP-LCG2 15m
        * Mario David reporting. Weekly Operations Status Report: LIP Reporting Period: 03/10/05 to 09/10/05 Availability of Core Services Hosted in the Site ================================================== RB: rb02.lip.pt PX: px01.lip.pt BDII: ii02.lip.pt (machines with problems) taken out of the GOC DB it will be substituted. We will keep the ii03 as production BDII BDII: ii03.lip.pt LFC: lfc01.lip.pt Non-Functional Time ==================== Three random Replica Management failures during the whole week Points to Raise at the Operations Meeting ========================================= Scheduled Down Time =================== Major Operational Issues Encountered During the Reporting Period ================================================================ The test BDII (ii03.lip.pt) passes now to production since the ii02 has serious problems, it will be deprecated for now, it was taken out of the GOCDB. We are presently draining the atlas and cms queues, but will not put a Scheduled Downtime, since site will continue operational for the other VO's. This is needed to apply maui policies which are not being "respected".
        Speaker: David, Mario (LIP)
      • IFAE 15m
        * Carlos reporting. Weekly Operations Status Report: [ IFAE ] Reporting Period: [ 10/10/05 ] to [ 17/10/05 ] Availability of Core Services Hosted in the Site ================================================== RB, BDII: ifaece02.ifae.es [OK] Non-Functional Time ==================== - Total days unavailable: 0 days Scheduled Down Time =================== Major Operational Issues Encountered During the ReportingB Period ================================================================ none Upgrade to Scientific Linux 3 (or equivalent) ============================================= By when will all service nodes in the Site be upgraded? done By when will the WNs in the Site be upgraded? done Points to Raise at the Operations Meeting ========================================= none
        Speaker: Borrego, Carlos (PIC)
      • PIC 15m
        * Carlos Borrego reporting. * Problem in Friday with jobs in MAUI. Reservations with the computer element failing. Weekly Operations Status Report: [ PIC ] Reporting Period: [ 10/10/05 ] to [ 17/10/05 ] Availability of Core Services Hosted in the Site ================================================== ce01.ifae.es bdii01.pic.es [OK] Non-Functional Time ==================== - Total days unavailable: 0 Scheduled Down Time =================== Major Operational Issues Encountered During the Reporting Period ================================================================ - ACSLS server down twice. - problem on friday with maui reservations. we were forced to kill one lhcb job. at the moment it seems stable Upgrade to Scientific Linux 3 (or equivalent) ============================================= By when will all service nodes in the Site be upgraded? Done By when will the WNs in the Site be upgraded? Done Points to Raise at the Operations Meeting ========================================= none
        Speaker: Borrego, Carlos (PIC)
      • UAM-LCG2 15m
        Weekly Operations Status Report: [ UAM-LCG2 ] Reporting Period: [ 10/10/05 ] to [ 17/10/05 ] Availability of Core Services Hosted in the Site ================================================== VOServer [OK] RB [OK] BDII [OK] Non-Functional Time ==================== SFT _____ JL --> 2005-10-12 18:05:18 to 2005-10-13 06:05:55 Error: CE was offline Scheduled Down Time =================== Major Operational Issues Encountered During the Reporting Period ================================================================ none Upgrade to Scientific Linux 3 (or equivalent) ============================================= By when will all service nodes in the Site be upgraded? [] Points to Raise at the Operations Meeting ========================================= none
        Speaker: Pardo Navarro, Juan Jose (UAM)
      • UB-LCG2 15m
        * Adrian Casajus reporting. * Firewall problem at the UB. Weekly Operations Status Report: UB Reporting Period: 10/10/2005 to 16/10/2005 Availability of Core Services Hosted in the Site ================================================ Non Core Service in the Site Non-Functional Time ==================== None Scheduled Down Time =================== None Major Operational Issues Encountered During the Reporting Period ================================================================ None Points to Raise at the Operations Meeting ========================================= None
        Speaker: Graciani, Ricardo and Casajus, Adrian (UB)
      • UPV-GRyCAP 15m
        * Reported by mail. * The issue is that they are at LCG 2.4 and no plans foreseen. Weekly Operations Status Report: [ UPV-GRyCAP ] Reporting Period: [ 10/10/05 ] to [ 14/10/05 ] Availability of Core Services Hosted in the Site ================================================== RB, BDII: apis.dsic.upv.es -> 0 days Non-Functional Time ==================== - Total days unavailable: 0 Scheduled Down Time =================== * Scheduled Maintenance During the Reporting Period - Total days unavailable 0 * Scheduled Maintenance During the Next Reporting Period - Estimated number of days for which the site will be unavailable 0 days Major Operational Issues Encountered During the Reporting Period ================================================================ none Upgrade to Scientific Linux 3 (or equivalent) ============================================= By when will all service nodes in the Site be upgraded? Already done (SL 3.0.4 & FC2) By when will the WNs in the Site be upgraded? Already done (FC2) Points to Raise at the Operations Meeting ========================================= none
        Speaker: Caballer, Miguel (tel. +34 963877007 ext 88254) (GRyCAP-ITACA (UPV))
      • USC-LCG2 15m
        Weekly Operations Status Report: [ USC-LCG2 ] Reporting Period: [ 08/09/2005 ] to [ 14/10/2005 ] Availability of Core Services Hosted in the Site ================================================== No Core Service Hosted. Non-Functional Time ==================== None Scheduled Down Time =================== * Scheduled Maintenance During the Reporting Period 4 days * Scheduled Maintenance During the Next Reporting Period No sched. mant. expected. Major Operational Issues Encountered During the Reporting Period ================================================================ None Upgrade to Scientific Linux 3 (or equivalent) ============================================= By when will all service nodes in the Site be upgraded? [ already done ] By when will the WNs in the Site be upgraded? [ already done ] Points to Raise at the Operations Meeting ========================================= None.
        Speaker: Saborido, Juan Jose
    • 12:10 → 12:15
      APEL Status Report 5m VRVS

      VRVS

      APEL STATUS REPORT == Period == From October 8 to October 14 == Summary == During this week, the Flexible Archiver has been down several days (13 and 14). This avoids publishing accounting data properly even if Apel is working fine in some sites. After this week this is the status of the federation related to accounting: * 12 sites have published their accounting data properly. * 1 site is in Scheduled Maintenance * 1 site is not publishing their accounting since 04/08/05 Regarding the CPU normalization test, in the web page http://mon.egee.cesga.es/sft/lastreport.cgi you can view the results of the test (take into account that this test is under development). The status at this moment is the following: * 8 sites have setup the cputmult factor properly * 4 sites should check the cputmult factor * 1 site has problems with the BDII, so the test has failed (0%) * 1 site is in Scheduled Maintenance There are some sites which don't have updated to LCG 2.6.0. If you need, in http://www.egee.cesga.es/EGEE-SA1-SWE/accounting/guides/ApelInstallationNotesForYaim/apel-yaim.html you can found information about the configuration of Apel in LCG 2.6.0. == Status of each SWE site == Site: BIFI Solved Problems of Last Report: Yes Missing Accounting Entries: Since 13/10/05 to 14/10/05 Publishing User Name Information: Yes Actions: Check the Apel logs Other Comments: Probably they don't have published data due to a R-GMA Server problem Site: CESGA Solved Problems of Last Report: Yes Missing Accounting Entries: 14/10/05 Publishing User Name Information: Yes Actions: Check the Apel logs Other Comments: Probably they don't have published data due to a R-GMA Server problem Site: CIEMAT Solved Problems of Last Report: Yes Missing Accounting Entries: 14/10/05 Publishing User Name Information: Yes. They have published some old records without this information Actions: Check the Apel logs Other Comments: Probably they don't have published data due to a R-GMA Server problem Site: CNB Solved Problems of Last Report: NO Missing Accounting Entries: Since 06/08/05 Publishing User Name Information: NO. Since 30/07/05 they are no publishing this information Actions: None Other Comments: They are updating to LCG 2.6.0 Site: ifae Solved Problems of Last Report: Yes Missing Accounting Entries: Since 13/10/05 to 14/10/05 Publishing User Name Information: Yes. They have published some old records without this information Actions: Check the Apel logs Other Comments: Probably they don't have published data due to a R-GMA Server problem Site: IFCA Solved Problems of Last Report: NO Missing Accounting Entries: Since 04/08/05 Publishing User Name Information: Yes Actions: They should check the Apel log files Other Comments: They have updated to LCG 2.6.0 and they are having problems with the connection to the accounting database in the MON Site: IFIC Solved Problems of Last Report: Yes Missing Accounting Entries: 14/10/05 Publishing User Name Information: Yes Actions: Check the Apel logs Other Comments: Probably they don't have published data due to a R-GMA Server problem Site: INTA Solved Problems of Last Report: Yes Missing Accounting Entries: Since 13/10/05 to 14/10/05 Publishing User Name Information: Yes Actions: Check the Apel logs Other Comments: Probably they don't have published data due to a R-GMA Server problem Site: LIP Solved Problems of Last Report: Yes Missing Accounting Entries: Since 13/10/05 to 14/10/05 Publishing User Name Information: None Actions: Check the Apel logs Other Comments: Probably they don't have published data due to a R-GMA Server problem Site: pic Solved Problems of Last Report: Yes Missing Accounting Entries: Since 13/10/05 to 14/10/05 Publishing User Name Information: Yes Actions: Check the Apel logs Other Comments: Probably they don't have published data due to a R-GMA Server problem Site: UAM Solved Problems of Last Report: Yes Missing Accounting Entries: Since 13/10/05 to 14/10/05 Publishing User Name Information: Yes Actions: Check the Apel logs Other Comments: Probably they don't have published data due to a R-GMA Server problem Site: UB Solved Problems of Last Report: Yes Missing Accounting Entries: 14/10/05 Publishing User Name Information: Yes. They have published some old records without this information Actions: Check the Apel logs Other Comments: Probably they don't have published data due to a R-GMA Server problem Site: UPV Solved Problems of Last Report: Yes Missing Accounting Entries: 14/10/05 Publishing User Name Information: Yes Actions: Check the Apel logs Other Comments: Probably they don't have published data due to a R-GMA Server problem Site: USC Solved Problems of Last Report: Yes Missing Accounting Entries: 14/10/05 Publishing User Name Information: NO. Since 13/10/05 they are no publishing this information Actions: Check the Apel logs and the Apel configuration Other Comments: Probably they don't have published data due to a R-GMA Server problem == Accounting Support == Accounting Web Page: http://www.egee.cesga.es/EGEE-SA1-SWE/accounting/ Accounting FAQ: http://www.egee.cesga.es/EGEE-SA1-SWE/accounting/faq.html Accounting Statistics: http://www.egee.cesga.es/EGEE-SA1-SWE/accounting/reports/ CPU Normalization: http://www.egee.cesga.es/EGEE-SA1-SWE/accounting/normalization.html Accounting Guides: http://www.egee.cesga.es/EGEE-SA1-SWE/accounting/guides/ Contact e-mail: egee-admin@cesga.es
      Speaker: Rey Mayo, Pablo (CESGA)
    • 12:15 → 12:30
      Action lists 15m VRVS

      VRVS

      Speaker: Pacheco, Andreu (IFAE)
      • 5.3.7.4 Mario to deploy gmdat monitoring tools in SWE (OPEN) 15m
        Sites which have deployed the sensor and are OK CESGA IFAE IFCA IFIC LIP PIC Sites which the sensors are not working presently but had deployed the tool BIFI UPV Sites which have not yet deployed, and should do so (come on, it only takes 5 minutes, if not tell me I am wrong) 'CIEMAT' => 'lcg02.ciemat.es', 'CNB' => 'mallarme.cnb.uam.es', 'INTA' => 'ce00.inta.es', 'UAM' => 'grid003.ft.uam.es', 'UB' => 'lcg-ce.ecm.ub.es', 'UCM' => 'DUMMYCE.ucm.es', 'USC' => 'lcg-ce.usc.cesga.es' go to http://grid-mon.lip.pt/grid-mon/index.php and in case of doubts send me mail
        Speaker: David, Mario (LIP)
      • 5.9.19.1 All sites to upgrade the gridice sensor in all machines 15m
        hay 3 sitios más que han actualizado el gridice sensor: CIEMAT, UAM, UB. La lista quedaría así: - Actualizados: BIFI, CESGA, CIEMAT, CNB, IFAE, LIP, PIC, UAM, UB, UPV, IFCA, IFIC, INTA - No actualizados: USC
        Speaker: Francisco Jose Bernabe Pellicer (CESGA)
      • 5.9.19.2 All sites to upgrade fmon2glue in gridice collector (NEW) 15m
        Speaker: Francisco Jose Bernabe Pellicer (CESGA)
      • 5.9.19.3 Request for volunteers to test network monitoring with GridICE (NEW) 15m
        Speaker: Francisco Jose Bernabe Pellicer (CESGA)
      • 5.9.19.4 All sites to feedback about GridICE e-mails (NEW) 15m
        Speaker: Francisco Jose Bernabe Pellicer (CESGA)
    • 12:20 → 12:35
      Preproduction Activity Status 15m VRVS

      VRVS

      This section will contain an update about the preproduction activity in SWE where more and more sites will be involved.
      Speaker: Pacheco, Andreu (IFAE)
      • PIC Report 15m
        * Carlos Borrego reporting. * Nick is asking who is going to Niza and he will request 1-2 slides per site.
        Speaker: Carlos Borrego (PIC)
      • CESGA 15m
        * Fco. Bernabe reporting. * Working in small configuration files (splitting) for easy upgrade.
        Speaker: Lopez, Javier (CESGA)
      • IFIC 15m
        * Alvaro Fernandez Casani. * No major changes. * Testing the FTS service.
        Speaker: Fernandez Casani, Alvaro (IFIC)
      • LIP 15m
        * Gonzalo Reporting. * Some error launching DAG jobs on the condor queue. * Antonio Retico requested to deploy gLite 1.4. Should we put effort in a common configuration file? * The certification team tested gLite first. Asking to them the configuration files would be a good start.
        Speaker: David, Mario (LIP)
      • INTA-CAB 15m
        * Kai Neuffer. * No news. Mauro Lopez on vacation.
        Speaker: Kai Neuffer (INTA-CAB)