EGEE-SA1-SWE Meeting

→ Europe/Zurich
VRVS Virtual Room (http://www.vrvs.org)

VRVS Virtual Room (http://www.vrvs.org)

Pacheco, Andreu
Description
Apologies: Jose Salt (CSIC/IFIC) Present: Andreu Pacheco (PIC), Carlos Borrego (PIC), Javi Fontan (CESGA), Kai Neuffer (INTA-CAB), Gonzalo Merino (PIC), Celso Martinez (IFCA), Carlos Fernandez (CESGA), Alvaro fernandez Casani (IFIC), Mario David (LIP), Adria Casajus (UB), Dani Cano (IFCA), Javier Sanchez (IFIC), Fco. Bernabe (CESGA), Javier Lopez (CESGA), Javier Palacios (IFIC)
    • 12:00 → 12:15
      Briefing of activities 15m VRVS

      VRVS

      Speaker: Pacheco, Andreu (IFAE/PIC)
      more information
    • 12:05 → 12:15
      Operational status from sites 10m VRVS

      VRVS

      * From February 1st 2005 all sites must report by mail their operational status each friday if they want Gonzalo Merino to report with accuracy their status to EGEE Operations Meeting * Since the people from CERN is asking the ROCs to write the monday's 11 report following a sort of template, I think it will be useful that the SWE Site Reports that site managers are sending on friday to this list, try to follow a similar template as well. I suggest then that these reports are produced following the template available at: https://services2.pic.org.es/devel/download/txt/SR-SWE-Template.txt * Reports should be sent to: egee.swe.roc.contact@pic.es The reports from SWE are appended to the agenda page of the weekly operation meetings: http://agenda.cern.ch/displayLevel.php?fid=258
      Speaker: Merino, Gonzalo (PIC)
      • BIFI-LCG 15m
        * Reported by Guillermo Losilla. * Problems in job submisions that seemed to be false positives. * Problems with the networking causing tests to fail. Probably due to traffic management. Weekly Operations Status Report: BIFI Reporting Period: 19/9/2005 to 23/9/2005 Availability of Core Services Hosted in the Site ================================================== No core services running at BIFI Non-Functional Time ==================== Several SFTs run by GOC failed along the reporting period: [JS] 2005-09-20 12:54:04 & 2005-09-20 15:05:16 Both them seem to be false positives, since they appear in most places of our federation [CT] Since 2005-09-22 most SFTs have failed in the replica management tests. The reason is a new "episode" of network problems due to the intervention of the Computer Center of our host university. We have contacted them and the problem should be solved in the beginning of the next week. Thanks to the last conversation with them, we got to improve remarkably our GIIS response time after being in INFO state during the last days (in the GSTAT test). Scheduled Down Time =================== No scheduled down time intervals during the reporting period. This Monday in the morning a scheduled network interruption will affect our facilities, therefore I may be unable to connect to the VRVS meeting. I have already added a scheduled downtime. Major Operational Issues Encountered During the Reporting Period ================================================================ We have also configured MAUI to solve the problem found last Monday; jobs from ATLAS where monopolizing our unique worker node, avoiding the SFTs to be executed. Thanks to Gonzalo Merino and Eduardo Huecha for their help. Upgrade to Scientific Linux 3 (or equivalent) ============================================= By when will all service nodes in the Site be upgraded? Already done (running SL 3.0.4) By when will the WNs in the Site be upgraded? Already done (running SL 3.0.4) Points to Raise at the Operations Meeting ========================================= none
        Speaker: Losilla Anadon, Guillermo (BIFI)
      • CESGA-EGEE 15m
        * Javi Fontan reporting. * Minor problems until today but now solved.
        Speaker: Lopez, Javier
      • CIEMAT-LCG2 15m
        * Reported by mail from Javier Calonge. * They are busy with CMS-SC3. Weekly Operations Status Report: CIEMAT-LCG2 Reporting Period: 13/09/05 to 23/09/05 Availability of Core Services Hosted in the Site ================================================== There is no core services running at CIEMAT at this moment Non-Functional Time ==================== None Scheduled Down Time =================== * Scheduled Maintenance During the Reporting Period 0 * Scheduled Maintenance During the Next Reporting Period 0 Major Operational Issues Encountered During the Reporting Period ================================================================ None Upgrade to LCG 2.6.0 ==================== At least two weeks ahead (due to Service Challenge 3)
        Speaker: Calonge, Javier (+34913466000 Ext: 6802) (CIEMAT)
      • CNB-LCG2 15m
        * No report. * Busy with the upgrade.
        Speaker: No contact person
      • IFCA-LCG2 15m
        * Report by Dani Cano. * Everything is working fine. Some false positives.
        Speaker: Cano, Dani
      • IFIC-LCG2 15m
        * Javier Sanchez reporting. * Some failures last week with tests. Problems with the BDII solved by changing the hardware.
        Speaker: Sanchez, Javier
      • INTA-CAB 15m
        * Kai Neufer reporting. * More or less everything OK. Weekly Operations Status Report: INTA-CAB Reporting Period: 19/09/05 to 23/09/05 Availability of Core Services Hosted in the Site ================================================ No core services hosted in this site. Non-Functional Time =================== 0 days. Scheduled Down Time =================== * Scheduled Maintenance During the Reporting Period 0 days. * Scheduled Maintenance During the Next Reporting Period 0 days. Major Operational Issues Encountered During the Reporting Period ================================================================ Monitoring problem on 19/09/2005 solved. Reason: The working maui.cfg file was lost on upgrading to 2_6_0. Soltion: Restoring the goot maui.cfg file. Upgrade to Scientific Linux 3 (or equivalent) ============================================= Already done. Points to Raise at the Operations Meeting ========================================= None.
        Speaker: Huedo, Eduardo
      • LIP-LCG2 15m
        Weekly Operations Status Report: LIP Reporting Period: 19/09/05 to 25/09/05 Availability of Core Services Hosted in the Site ================================================== RB: rb02.lip.pt PX: px01.lip.pt BDII: ii02.lip.pt LFC: lfc01.lip.pt Non-Functional Time ==================== 2 [JS] failures on the 20 the rest is OK There are either "Warning" of "Failure" of apel, this is intermintent also. The accouting seems to be working OK. Points to Raise at the Operations Meeting ========================================= None
        Speaker: David, Mario
      • IFAE 15m
        Weekly Operations Status Report: [ IFAE ] Reporting Period: [ 19/09/05 ] to [ 25/09/05 ] Availability of Core Services Hosted in the Site ================================================== RB, BDII: ifaece02.ifae.es [OK] Non-Functional Time ==================== - Total days unavailable: 0 days Scheduled Down Time =================== Major Operational Issues Encountered During the Reporting Period ================================================================ none Upgrade to Scientific Linux 3 (or equivalent) ============================================= By when will all service nodes in the Site be upgraded? done By when will the WNs in the Site be upgraded? done Points to Raise at the Operations Meeting ========================================= none
        Speaker: Borrego, Carlos
      • PIC 15m
        Weekly Operations Status Report: [ PIC ] Reporting Period: [ 19/09/05 ] to [ 25/09/05 ] Availability of Core Services Hosted in the Site ================================================== ce01.ifae.es bdii01.pic.es [OK] Non-Functional Time ==================== - Total days unavailable: 0 Scheduled Down Time =================== Major Operational Issues Encountered During the Reporting Period ================================================================ Monday 19th: False positive on our SFT test Thursday 22nd: False positive again on the rm test Upgrade to Scientific Linux 3 (or equivalent) ============================================= By when will all service nodes in the Site be upgraded? Done By when will the WNs in the Site be upgraded? Done Points to Raise at the Operations Meeting ========================================= none
        Speaker: Borrego, Carlos
      • UAM-LCG2 15m
        Weekly Operations Status Report: [ UAM-LCG2 ] Reporting Period: [ 17/09/05 ] to [ 25/09/05 ] Availability of Core Services Hosted in the Site ================================================== MyProxy [OK] VOServer [OK] RB [OK] BDII [OK] Non-Functional Time ==================== Problem: a) with GIIS of UAM. I solved this problem restarting the service. This service is down frequently. b) problem with dcache server, I solved the problem restarting the services of DCACHE - 2005-09-19 09:05:45 Job submission failed - 2005-09-20 15:05:16 Job submission failed - From 2005-09-24 00:05:16 Job submission failed to 2005-09-25 09:05:54 Job submission failed Scheduled Down Time =================== Major Operational Issues Encountered During the Reporting Period ================================================================ none Upgrade to Scientific Linux 3 (or equivalent) ============================================= By when will all service nodes in the Site be upgraded? I will update to lcg2_6_0 the next week [3-10-2005 .. 7-10-2005], we will do changes of infrastructure too. Points to Raise at the Operations Meeting ========================================= none
        Speaker: Pardo Navarro, Juan Jose
      • UB-LCG2 15m
        Weekly Operations Status Report: UB Reporting Period: 19/09/2005 to 25/09/2005 Availability of Core Services Hosted in the Site ================================================ Non Core Service in the Site Non-Functional Time ==================== all week Scheduled Down Time =================== untill tonight. Upgrade to LCG-2_6_0 + cluster reconfiguration. Major Operational Issues Encountered During the Reporting Period ================================================================ None Points to Raise at the Operations Meeting ========================================= None
        Speaker: Graciani, Ricardo and Casajus, Adrian (UB)
      • UPV-GRyCAP 15m
        Weekly Operations Status Report: [ UPV-GRyCAP ] Reporting Period: [ 19/09/05 ] to [ 23/09/05 ] Availability of Core Services Hosted in the Site ================================================== RB, BDII: apis.dsic.upv.es -> 0 days Non-Functional Time ==================== - Total days unavailable: 0 Scheduled Down Time =================== * Scheduled Maintenance During the Reporting Period - Total days unavailable 0.5 day (21/09/2005 night - Power supply interruption) * Scheduled Maintenance During the Next Reporting Period - Estimated number of days for which the site will be unavailable 0 days Major Operational Issues Encountered During the Reporting Period ================================================================ none Upgrade to Scientific Linux 3 (or equivalent) ============================================= By when will all service nodes in the Site be upgraded? Already done (SL 3.0.4 & FC2) By when will the WNs in the Site be upgraded? Already done (FC2) Points to Raise at the Operations Meeting ========================================= none
        Speaker: Caballer, Miguel (tel. +34 963877007 ext 88254) (GRyCAP-ITACA (UPV))
      • USC-LCG2 15m
        Speaker: Saborido, Juan
    • 12:10 → 12:15
      APEL Status Report 5m VRVS

      VRVS

      * (Javier Lopez) Problem related to the SFT test for Apel. Sometimes failures are seen. False positives due to the central server. You cannot reply on SFT now. APEL STATUS REPORT == Period == From September 17 to September 23 == Summary == September 23 Flexible Archiver has been down. This avoids publishing accounting data this day even if Apel is working fine in some sites. After this week this is the status of the federation related to accounting: * 9 sites have published their accounting data properly. * 2 sites are in Scheduled Maintenance * 2 sites have published almost every their accounting data except one or two days. * Only 1 site is not publishing their accounting since 04/08/05 There are some sites which don't have updated to LCG 2.6.0. If you need, in http://www.egee.cesga.es/EGEE-SA1-SWE/accounting/guides/ApelInstallationNotesForYaim/apel-yaim.html you can found information about the configuration of Apel in LCG 2.6.0. == Status of each SWE site == Site: BIFI Solved Problems of Last Report: Yes Missing Accounting Entries: None Publishing User Name Information: Yes Actions: None Other Comments: None Site: CESGA Solved Problems of Last Report: Yes Missing Accounting Entries: None Publishing User Name Information: Yes Actions: None Other Comments: None Site: CIEMAT Solved Problems of Last Report: Yes Missing Accounting Entries: None Publishing User Name Information: Yes. They have published some old records without this information Actions: None Other Comments: None Site: CNB Solved Problems of Last Report: NO Missing Accounting Entries: Since 06/08/05 Publishing User Name Information: NO. Since 30/07/05 they are no publishing this information Actions: None Other Comments: They are updating to LCG 2.6.0 Site: ifae Solved Problems of Last Report: Yes Missing Accounting Entries: None Publishing User Name Information: Yes. They have published some old records without this information Actions: None Other Comments: None Site: IFCA Solved Problems of Last Report: NO Missing Accounting Entries: Since 04/08/05 Publishing User Name Information: Yes Actions: They should check the Apel log files Other Comments: They have updated to LCG 2.6.0 and they are having problems with the connection to the accounting database in the MON Site: IFIC Solved Problems of Last Report: Yes Missing Accounting Entries: Since 22/09/05 Publishing User Name Information: Yes Actions: Check the apel log Other Comments: None Site: INTA Solved Problems of Last Report: Yes Missing Accounting Entries: None Publishing User Name Information: Yes Actions: None Other Comments: None Site: LIP Solved Problems of Last Report: Yes Missing Accounting Entries: None Publishing User Name Information: Yes. They have published some old records without this information Actions: None Other Comments: None Site: pic Solved Problems of Last Report: Yes Missing Accounting Entries: None Publishing User Name Information: Yes Actions: None Other Comments: None Site: UAM Solved Problems of Last Report: Yes Missing Accounting Entries: None Publishing User Name Information: Yes Actions: None Other Comments: None Site: UB Solved Problems of Last Report: Yes Missing Accounting Entries: Since 21/09/05 Publishing User Name Information: Yes Actions: None Other Comments: They are updating to LCG 2.6.0 Site: UPV Solved Problems of Last Report: Yes Missing Accounting Entries: 21/09/05 Publishing User Name Information: Yes Actions: Check the apel log Other Comments: None Site: USC Solved Problems of Last Report: Yes Missing Accounting Entries: None Publishing User Name Information: Yes Actions: None Other Comments: None == Accounting Support == Accounting Web Page: http://www.egee.cesga.es/EGEE-SA1-SWE/accounting/ Accounting FAQ: http://www.egee.cesga.es/EGEE-SA1-SWE/accounting/faq.html Accounting Statistics: http://www.egee.cesga.es/EGEE-SA1-SWE/accounting/reports/ CPU Normalization: http://www.egee.cesga.es/EGEE-SA1-SWE/accounting/normalization.html Accounting Guides: http://www.egee.cesga.es/EGEE-SA1-SWE/accounting/guides/ Contact e-mail: egee-admin@cesga.es
      Speaker: Rey Mayo, Pablo (CESGA)
    • 12:15 → 12:30
      Action lists 15m VRVS

      VRVS

      Speaker: Pacheco, Andreu (IFAE)
      • 5.3.7.4 Mario to deploy gmdat monitoring tools in SWE (OPEN) 15m
        * Mario reporting. * He is still analysing the data to cross-check collected results. He has asked to upgrade the scripts to all sites. Some improvements have been done in the monitoring. * Mario is checking also GridICE. * All sites upgrading please contact Mario.
        Speaker: David, Mario (LIP)
      • 5.9.19.1 All sites to upgrade the gridice sensor in all machines (NEW) 15m
        * Done for CESGA, BIFI, LIP, PIC
        Speaker: Francisco Jose Bernabe Pellicer (CESGA)
      • 5.9.19.2 All sites to upgrade fmon2glue in gridice collector (NEW) 15m
        * Done for CESGA, BIFI, LIP
        Speaker: Francisco Jose Bernabe Pellicer (CESGA)
      • 5.9.19.3 Request for volunteers to test network monitoring with GridICE (NEW) 15m
        * LIP and CESGA participating. * RPMs at LIP already installed. * Augusto Ciuffuletti sent instructions last friday.
        Speaker: Francisco Jose Bernabe Pellicer (CESGA)
      • 5.9.19.4 All sites to feedback about GridICE e-mails (NEW) 15m
        * When a site changes status an email is sent by GridICE.
        Speaker: Francisco Jose Bernabe Pellicer (CESGA)
    • 12:20 → 12:35
      Preproduction Activity Status 15m VRVS

      VRVS

      This section will contain an update about the preproduction activity in SWE where more and more sites will be involved.
      Speaker: Pacheco, Andreu (PIC)
      • PIC Report 15m
        * Carlos Borrego reporting. * Migration to 1.3 postponed. * Busy with connecting PPS to the production facility for CMS. Hopefully to finish this week.
        Speaker: Carlos Borrego (PIC)
      • CESGA 15m
        * Fco Bernabé reporting. * Upgrading services to 1.3 * Mario proposes that some parts of the configuration file should be shared (endpoints, VO servers, ...) to all PPS sites. * Javier Lopez replies that common information from 1.4 will come from R-GMA server with automatic service discovery. * Agreement to wait until 1.4 for common configuration files.
        Speaker: Lopez, Javier (CESGA)
      • IFIC 15m
        * Alvaro reporting. * Also a problem with Castor SRM after to production site LCG 2.6 upgrade. * FTS tested with dteam VO but with other PPS VOs it fails. Security model conflicting internally.
        Speaker: Fernandez Casani, Alvaro (IFIC)
      • LIP 15m
        * Mario David reporting. * A lot of problems with DPM and I/O Server. Main issue.
        Speaker: David, Mario (LIP)
      • INTA-CAB 15m
        * Kai reporting. * New site * Installing gLite 1.3
        Speaker: Kai Neuffer