Deployment team

→ Europe/Zurich
EVO - GridPP Deployment team meeting

EVO - GridPP Deployment team meeting

Jeremy Coles
Description
- This is the weekly DTEAM meeting - The intention is to run the meeting in EVO: http://evo.caltech.edu/evoGate/. Join the meeting in the GridPP Community area
Minutes
    • 11:00 → 11:20
      Experiment problems/issues 20m
      Review of weekly issues by experiment/VO - LHCb - CMS CMS CSA07 now to continue till mid-November. - ATLAS ATLAS throughput tests finished and M5 detector cosmics now running till 5 November. Data export from CERN later in the week. - Steve's "new" view: http://hepwww.ph.qmul.ac.uk/~lloyd/gridpp/ukgrid.html - Other
    • 11:20 → 11:35
      ROC update 15m
      ROC manager update ************************* Top-level BDIIs: "It is suspected that many top level BDIIs have not been upgraded to the most recent version. The proposal is the following: 1. Each ROC makes sure the region runs a load balanced BDII with 2+ nodes 2. Sites with more than, say 1000 CPUs set up a local top-level BDII for local usage 3. CERN provides a default load balanced BDII to be used when the "local" services are not available 4. SAM tests these production BDIIs. Sites can use other BDIIs at their own risk (no support) 5. In addition: o We ask for SAM/Gstat to monitor the top level BDIIs, with the intention alarms being raised for the CODs o We ask that the middleware be enhanced so that job submission can either be configured with a list of BDIIs or can discover BDIIs (service discovery) " Ticket status *************** See attached list - as at Monday 22nd EGEE ops meeting items of interest ****************************************** LCG-CE on SL4: * gLite 3.1.0 PPS Update08 was release to PPS and it is currently undergoing the pre-deployment testing This update contains (among other patches) the new service: o lcg-CE for SLC4 Due to the fact that lcg-CE requires the latest version of glite-yaim-core (patch #1413), new versions of yaim client packages (patch #1415) need tobe released to PPS as well, namely: o glite-yaim-clients-4.0.1-1.noarch.rpm o glite-yaim-torque-client-4.0.1-1.noarch.rpm as well as the following new metapackages, which were affected: o PPS-glite-TORQUE_client-3.1.0-5.noarch.rpm o PPS-glite-UI-3.1.0-8.noarch.rpm o PPS-glite-WN-3.1.0-8.noarch.rpm Difficult to follow but.... There is a new tool in the CIC Portal for announcing site and service downtimes. Features of the tool are: 1. Uses standardized templates so all announcements will look similar (easier to scan) and all relevant information will be captured (no missing information) 2. The template will include a more targeted set of recipients of a broadcast (spam reduction) 3. You can subscribe to an RSS feed of messages (by type) rather than receiving them in your inbox (spam reduction) This should be released Tuesday afternoon. The old broadcast functionality remains in place but this should prevent the need for two entries for downtimes (GOCD + broadcast). We may have access to the documentation today. Problem of the VOView consistency. Signaled 3 weeks ago, still 90 queues have problems. The new list under the usual http://voatlas01.cern.ch/atlas/data/VOViewProblem.log UK sites still impacted are: CE:epgce2.ph.bham.ac.uk:2119/jobmanager-lcgpbs-short TOTrun:2 TOTVOrun:0 TOTwait:0 TOTVOwait:0 CE:hep-ce.cx1.hpc.ic.ac.uk:2119/jobmanager-pbs-heplt2 TOTrun:336 TOTVOrun:6384 TOTwait:1465 TOTVOwait:27835 CE:hepgrid2.ph.liv.ac.uk:2119/jobmanager-lcgpbs-atlas TOTrun:0 TOTVOrun:0 TOTwait:4444 TOTVOwait:13332 CE:heplnx206.pp.rl.ac.uk:2119/jobmanager-lcgpbs-atlas TOTrun:3 TOTVOrun:0 TOTwait:0 TOTVOwait:0 CE:mars-ce2.mars.lesc.doc.ic.ac.uk:2119/jobmanager-sge-10min TOTrun:1 TOTVOrun:0 TOTwait:0 TOTVOwait:0 CE:t2ce03.physics.ox.ac.uk:2119/jobmanager-lcgpbs-short TOTrun:9 TOTVOrun:0 TOTwait:0 TOTVOwait:0 Feeback from Graeme "epgce2.ph.bham.ac.uk:2119/jobmanager-lcgpbs-short, t2ce03.physics.ox.ac.uk:2119/jobmanager-lcgpbs-short are probably OK - these are shared queues after all, so VOjobs < QueueJobs is normal. Liverpool are "fixed", but their BDII suffers from CE load (hence the 4444). They told me hardware improvements are in the pipeline when I ticketed them. LeSC have deployed a new version of the SGE plugin (as have IC-HEP), so their numbers are probably correct (VOJobs < QueueJobs). * RALPP I'm sure Chris fixed, but it's somehow been unfixed - needs chased. * The IC hep-ce.cx1.hpc.ic.ac.uk queue is well broken. It should use the pbs plugin, so be fixable. "
      more information
    • 11:35 → 11:40
      Site issues 5m
      - Use of broadcast tool (see Andrew's blog rant!)
    • 11:40 → 11:55
      EGEE - SLDs 15m
      - See proposal in mail - Current draft https://edms.cern.ch/document/860386
    • 11:55 → 12:10
      Actions review 15m
    • 12:10 → 12:15
      AOB 5m
      - Software licence issues (ref: site Nagios scripts) -- During Monday's PMB the GridPP policy was highlighted ( ). It follows http://eu-datagrid.web.cern.ch/eu-datagrid/license.html. Sites should use the DataGrid policy or revised BSD policy. This should not be a sticking issue for any site (copyright remains with the institute of the developer). - Apparently the UI can now deal with service discovery (i.e. WMS) - has anyone seen or tested this functionality?