Production and PASTE Meeting, 21st October 2008, CERN
Chair: A.Tsaregorodtsev
Minutes: S. Paterson
CERN: P.Charpentier, J.Closier, S.Paterson, R.Santinelli, M.Sapunov, A.C.Smith
Phone: N.Brook, R.Graciani, A.Tsaregorodtsev
Apologies: Z.Mathe
0. Ongoing Action List
(07) - 27/11/07 - Zoltan, Elisa - Ongoing new bookkeeping system development. Migration plan
(57) - 24/06/08 - Vladimir,Roberto - Automatic publishing of BDII / GOCDB information in the CS using GOCDB site names and provide a summary of recent changes
(82) - 01/09/08 - Andrei/Adri - to provide information from Accounting and WMS to allow GridMap for LHCb VO T1 activity
(83) - 01/09/08 - Stuart,Roberto - To perform glexec tests
(90) - 09/09/08 - Joel - Use new ProductionOutputData JDL parameter in modules instead of creating LFNs
(93) - 16/09/08 - Andrew - Improve RAW data monitoring tools and status of files in online runDB
(94) - 23/09/08 - Roberto, Marcos - Using SystemLogging service for dynamic services status monitoring
(95) - 23/09/08 - Roberto - SLS and SAM sensors development, upgrade SE tests with new DMS unit test
(96) - 23/09/08 - Roberto, Matvey - Dashboard SAM tests visualization, porting to DIRAC framework
(103) - 23/09/08 - Paul, Stuart - produce structured HTML version of the Shifter's guide
(106) - 30/09/08 - Ricardo - Produce twiki documentation for dirac-install
(107) - 30/09/08 - Ricardo/Philippe/Joel/Hubert/MarcoC - Produce proposal for how to perform standardised installation using install_project/CMT
(109) - 14/09/08 - Matvey - Expose DataLogging interface on the web page
(111) - 14/09/08 - Philippe - Update file merging proposal after email discussions
Completed Actions:
Done - (86) - 09/09/08 - Andrei - Document the job finalization policy
Done - (102) - 23/09/08 - Matvey, Adria - Documenting the DIRAC Web portal installation on volhcb11
Done - (108) - 14/09/08 - Roberto - Stop fake data publishing to SRMv1 endpoints and raise issue of why this is necessary
Done - (110) - 14/09/08 - Stuart - Create guide on current understanding of how to get to 100% processing efficiency
1. Action Updates
- Action(07) - Prototype Bookkeeping
Philippe summarized that the migration to the production Oracle backend is planned in the next two weeks. The
roadmap for moving to the new BK is also being prepared.
- Action(57) - Automatic publishing of BDII / GOCDB information in the CS
Ongoing.
- Action(82) - Provide accounting information to allow GridMap for LHCb VO T1 activity
Ongoing, data from the accounting and WMS job DBs is to be correlated.
- Action(83) - gLexec tests
Stuart mentioned that there were problems with the DIRAC proxy (serial number) and since it seemed to be a quick
fix the tests were put on hold.
- Action(86) - Document job finalization policy
After the comments from the first draft and today's discussions Andrei confirmed that the twiki page reflects the final
situation.
- Action(90) - Production Output Data parameter
Ongoing. Joel will convey any missing parameters to Stuart to allow the LFNs to be used in one place.
- Action(93) - Improve RAW data monitoring tools and status of files in online runDB
Ongoing.
- Action(94) - SystemLogging
No progress on this action. There was some discussion regarding the use of the Logger and it was suggested to
demonstrate at least one example highlighting the benefits of this service.
- Action(95) - SLS / SAM
Roberto retired the SRMv1 suite as discussed last week and removed the criticality of the related tests. For SRMv2
the tests are not currently taken into account for site availability. A new test using the Data Management components
is under preparation. SLS information is augmented with the URL of the service from the ping() method.
- Action(96) - Dashboard
Matvey did not yet receive the URL of the Dashboard information. Roberto will resend.
- Action(102) - Documenting the DIRAC Web portal installation on volhcb11
Action is closed, Matvey circulated an email.
- Action(103) - produce structured HTML version of the Shifter's guide
On hold due to the disk space restrictions on volhcb06.
- Action(106) - Ricardo - Produce twiki documentation for dirac-install
Ongoing mail discussions.
- Action(107) - Produce proposal for how to perform standardised installation using install_project/CMT
Ongoing.
- Action(109) - Expose DataLogging interface on the web page
Ongoing.
- Action(110) - Create guide on current understanding of how to get to 100% processing efficiency
Stuart circulated a twiki link to stimulate email discussions.
- Action(111) - Update file merging proposal after email discussions
2. Production Status Report
- Report from the Production meeting
Stuart reported that the recent productions run last weekend were affected mainly by the software issues that were
summarized in Philippe's mail. With Vladimir's help over the weekend these productions ran almost to completion and
will be extended to completion. Andrew mentioned that the BK requests for the new productions were failing, difficult
to proceed in the absence of Zoltan. Some protection may be required for the kill operation in the future assuming
this was the cause of the recent problems with hanging jobs.
- DIRAC2 user system status
Andrei mentioned that the recent instabilities with the user system were due to an old UI in the setup script of the
agent. For some users there are still proxy related problems that result in many aborted agents at the RB and CE
level.
3. FEST'09 Run
See material attached to the agenda page.
4. DIRAC3 Tasks
- Software installation
Summarized in Philippe's mail and Production Operations actions.
- Separation of DIRAC and WorkflowLib
Separation is done. For conveniency, a tagged version of WorkflowLib is kept inside DIRAC distribution to facilitate testing of development releases.
- Upcoming DIRAC release
The fix for ensuring correct MySQL default values for sandboxes is being prepared.
- Using LHCb voboxes at CERN
volhcb01 (large 1TB disk) could be used as a sandbox SE and the development system can move to volhcb02 (WMS) and volhcb08 (DMS) with volhcb 01, 09, 10 in production and 06 with 2TB for a dips SE.
5. AOB
- CHEP abstracts
Discussion on the proposals are invited via mail.
- DIRAC3 week
The proposed date for the next DIRAC3 week is November 17th.
There are minutes attached to this event.
Show them.