PASTE meeting

→ Europe/Zurich
2/R-030 (CERN)

2/R-030

CERN

30
Show room on map
Andrei Tsaregorodtsev
Description
CERN, bat 2 R-030 To join the telephone conference, click here: https://audioconf.cern.ch/call/0165202 To dial in to the conference: a. Dial +41 22 7676000 b. Enter access code 0165202
Production and PASTE Meeting, 21st October 2008, CERN Chair: A.Tsaregorodtsev Minutes: S. Paterson CERN: P.Charpentier, J.Closier, S.Paterson, R.Santinelli, M.Sapunov, A.C.Smith Phone: N.Brook, R.Graciani, A.Tsaregorodtsev Apologies: Z.Mathe 0. Ongoing Action List (07) - 27/11/07 - Zoltan, Elisa - Ongoing new bookkeeping system development. Migration plan (57) - 24/06/08 - Vladimir,Roberto - Automatic publishing of BDII / GOCDB information in the CS using GOCDB site names and provide a summary of recent changes (82) - 01/09/08 - Andrei/Adri - to provide information from Accounting and WMS to allow GridMap for LHCb VO T1 activity (83) - 01/09/08 - Stuart,Roberto - To perform glexec tests (90) - 09/09/08 - Joel - Use new ProductionOutputData JDL parameter in modules instead of creating LFNs (93) - 16/09/08 - Andrew - Improve RAW data monitoring tools and status of files in online runDB (94) - 23/09/08 - Roberto, Marcos - Using SystemLogging service for dynamic services status monitoring (95) - 23/09/08 - Roberto - SLS and SAM sensors development, upgrade SE tests with new DMS unit test (96) - 23/09/08 - Roberto, Matvey - Dashboard SAM tests visualization, porting to DIRAC framework (103) - 23/09/08 - Paul, Stuart - produce structured HTML version of the Shifter's guide (106) - 30/09/08 - Ricardo - Produce twiki documentation for dirac-install (107) - 30/09/08 - Ricardo/Philippe/Joel/Hubert/MarcoC - Produce proposal for how to perform standardised installation using install_project/CMT (109) - 14/09/08 - Matvey - Expose DataLogging interface on the web page (111) - 14/09/08 - Philippe - Update file merging proposal after email discussions Completed Actions: Done - (86) - 09/09/08 - Andrei - Document the job finalization policy Done - (102) - 23/09/08 - Matvey, Adria - Documenting the DIRAC Web portal installation on volhcb11 Done - (108) - 14/09/08 - Roberto - Stop fake data publishing to SRMv1 endpoints and raise issue of why this is necessary Done - (110) - 14/09/08 - Stuart - Create guide on current understanding of how to get to 100% processing efficiency 1. Action Updates - Action(07) - Prototype Bookkeeping Philippe summarized that the migration to the production Oracle backend is planned in the next two weeks. The roadmap for moving to the new BK is also being prepared. - Action(57) - Automatic publishing of BDII / GOCDB information in the CS Ongoing. - Action(82) - Provide accounting information to allow GridMap for LHCb VO T1 activity Ongoing, data from the accounting and WMS job DBs is to be correlated. - Action(83) - gLexec tests Stuart mentioned that there were problems with the DIRAC proxy (serial number) and since it seemed to be a quick fix the tests were put on hold. - Action(86) - Document job finalization policy After the comments from the first draft and today's discussions Andrei confirmed that the twiki page reflects the final situation. - Action(90) - Production Output Data parameter Ongoing. Joel will convey any missing parameters to Stuart to allow the LFNs to be used in one place. - Action(93) - Improve RAW data monitoring tools and status of files in online runDB Ongoing. - Action(94) - SystemLogging No progress on this action. There was some discussion regarding the use of the Logger and it was suggested to demonstrate at least one example highlighting the benefits of this service. - Action(95) - SLS / SAM Roberto retired the SRMv1 suite as discussed last week and removed the criticality of the related tests. For SRMv2 the tests are not currently taken into account for site availability. A new test using the Data Management components is under preparation. SLS information is augmented with the URL of the service from the ping() method. - Action(96) - Dashboard Matvey did not yet receive the URL of the Dashboard information. Roberto will resend. - Action(102) - Documenting the DIRAC Web portal installation on volhcb11 Action is closed, Matvey circulated an email. - Action(103) - produce structured HTML version of the Shifter's guide On hold due to the disk space restrictions on volhcb06. - Action(106) - Ricardo - Produce twiki documentation for dirac-install Ongoing mail discussions. - Action(107) - Produce proposal for how to perform standardised installation using install_project/CMT Ongoing. - Action(109) - Expose DataLogging interface on the web page Ongoing. - Action(110) - Create guide on current understanding of how to get to 100% processing efficiency Stuart circulated a twiki link to stimulate email discussions. - Action(111) - Update file merging proposal after email discussions 2. Production Status Report - Report from the Production meeting Stuart reported that the recent productions run last weekend were affected mainly by the software issues that were summarized in Philippe's mail. With Vladimir's help over the weekend these productions ran almost to completion and will be extended to completion. Andrew mentioned that the BK requests for the new productions were failing, difficult to proceed in the absence of Zoltan. Some protection may be required for the kill operation in the future assuming this was the cause of the recent problems with hanging jobs. - DIRAC2 user system status Andrei mentioned that the recent instabilities with the user system were due to an old UI in the setup script of the agent. For some users there are still proxy related problems that result in many aborted agents at the RB and CE level. 3. FEST'09 Run See material attached to the agenda page. 4. DIRAC3 Tasks - Software installation Summarized in Philippe's mail and Production Operations actions. - Separation of DIRAC and WorkflowLib Separation is done. For conveniency, a tagged version of WorkflowLib is kept inside DIRAC distribution to facilitate testing of development releases. - Upcoming DIRAC release The fix for ensuring correct MySQL default values for sandboxes is being prepared. - Using LHCb voboxes at CERN volhcb01 (large 1TB disk) could be used as a sandbox SE and the development system can move to volhcb02 (WMS) and volhcb08 (DMS) with volhcb 01, 09, 10 in production and 06 with 2TB for a dips SE. 5. AOB - CHEP abstracts Discussion on the proposals are invited via mail. - DIRAC3 week The proposed date for the next DIRAC3 week is November 17th.
There are minutes attached to this event. Show them.
    • 09:50 → 10:10
      Ongoing actions 20m
      (07) - 27/11/07 - Zoltan, Elisa - Ongoing new bookkeeping system development. Migration plan (57) - 24/06/08 - Vladimir,Roberto - Automatic publishing of BDII / GOCDB information in the CS using GOCDB site names and provide a summary of recent changes (82) - 01/09/08 - Andrei/Adri - to provide information from Accounting and WMS to allow GridMap for LHCb VO T1 activity (83) - 01/09/08 - Stuart,Roberto - To perform glexec tests (86) - 09/09/08 - Andrei - Document the job finalization policy (90) - 09/09/08 - Joel - Use new ProductionOutputData JDL parameter in modules instead of creating LFNs (93) - 16/09/08 - Andrew - Improve RAW data monitoring tools and status of files in online runDB (94) - 23/09/08 - Roberto, Marcos - Using SystemLogging service for dynamic services status monitoring (95) - 23/09/08 - Roberto - SLS and SAM sensors development, upgrade SE tests with new DMS unit test (96) - 23/09/08 - Roberto, Matvey - Dashboard SAM tests visualization, porting to DIRAC framework (102) - 23/09/08 - Matvey, Adria - Documenting the DIRAC Web portal installation on volhcb11 (103) - 23/09/08 - Paul, Stuart - produce structured HTML version of the Shifter's guide (106) - 30/09/08 - Ricardo - Produce twiki documentation for dirac-install (107) - 30/09/08 - Ricardo/Philippe/Joel/Hubert/MarcoC - Produce proposal for how to perform standardised installation using install_project/CMT (108) - 14/09/08 - Roberto - Stop fake data publishing to SRMv1 endpoints and raise issue of why this is necessary (109) - 14/09/08 - Matvey - Expose data logging interface on the web page (110) - 14/09/08 - Stuart - Create guide on current understanding of how to get to 100% processing efficiency (111) - 14/09/08 - Philippe - Update file merging proposal after email discussions
    • 10:10 → 10:25
      Production status report 15m
      - Report from the Production meeting: - DIRAC2 user system status
    • 10:25 → 10:45
      FEST'09 run 20m
      Speaker: Philippe Charpentier
      Fest'09 plans
    • 10:45 → 11:15
      DIRAC3 tasks 30m
      - Software installation - Separation of DIRAC and WorkflowLib - upcoming DIRAC release - using LHCb voboxes at CERN
    • 11:15 → 11:25
      AOB 10m
      - CHEP abstracts - DIRAC3 week
      document