Choose timezone
Your profile timezone:
PASTE meeting
→
Europe/Zurich
2-R-014 (CERN)
2-R-014
CERN
Description
CERN, bat 2 R-030
To join the telephone conference, click here: https://audioconf.cern.ch/call/0165202
To dial in to the conference:
a. Dial +41 22 7676000
b. Enter access code 0165202
Production and PASTE Meeting, 2nd December 2008, CERN
Chair: A.Tsaregorodtsev
Minutes: S. Paterson
CERN: J.Closier, Z.Mathe, S.Paterson, R.Santinelli
Phone: N.Brook, R.Graciani, M.Sapunov, A.Tsaregorodtsev
Apologies: P.Charpentier, A.C.Smith
0. Ongoing Action List
(07) - 27/11/07 - Zoltan, Elisa - Ongoing new bookkeeping system development. Migration plan
(57) - 24/06/08 - Vladimir,Roberto - Automatic publishing of BDII / GOCDB information in the CS using GOCDB site names and provide a summary of recent changes
(83) - 01/09/08 - Stuart,Roberto - To perform glexec tests
(90) - 09/09/08 - Joel,Stuart - Use new ProductionOutputData JDL parameter in modules instead of creating LFNs
(93) - 16/09/08 - Andrew - Improve RAW data monitoring tools and status of files in online runDB
(94) - 23/09/08 - Andrew, Marcos - Using SystemLogging service for dynamic services status monitoring (Andrew to provide FTS example)
(95) - 23/09/08 - Roberto - SLS and SAM sensors development, upgrade SE tests with new DMS unit test
(96) - 23/09/08 - Roberto - Update Dashboard SAM tests visualization
(106) - 30/09/08 - Ricardo - Produce twiki documentation for dirac-install
(107) - 30/09/08 - Ricardo,Philippe,Joel,Hubert,MarcoC - Produce proposal for how to perform standardised installation using install_project/CMT
(109) - 14/09/08 - Matvey,Andrew - Expose DataLogging interface on the web page
(111) - 14/09/08 - Philippe,Alexei,Andrei - Productions with file merging and associated data distribution implementation
(113) - 21/10/08 - Ricardo, Adri - Document the CS procedures for both the mechanism to define authorization rules in DIRAC and also the current group properties
(115) - 21/10/08 - Vladimir,Matvey - Update SAM Agent to monitor and manage submitted jobs and publish results for faulty CEs to the SAM DB
(116) - 18/11/08 - Ricardo - Circulate a report on the recent Gauss CPU studies, steer the CPU related activities in DIRAC
(117) - 18/11/08 - Ricardo - Add a site attribute to reflect whether generic pilots are accepted there, update the Director
(118) - 25/11/08 - Roberto - Provide script to demonstrate GFAL thread safety issue and submit a Savannah bug
Completed Actions:
Done - (119) - 02/12/08 - Stuart - Provide procedure for new genCatalog functionality
1. Action Updates
- Action(07) - Prototype Bookkeeping
Zoltan mentioned that the latest GUI commits are in place. Stuart commented that the ancestor files and genCatalog
functionality is now ready to be used and agreed to write a procedure for this ( ACTION: Stuart ).
- Action(57) - Automatic publishing of BDII / GOCDB information in the CS
After tests Roberto confirms that the top level production BDII should be the correct place to gather information about
sites supporting LHCb. CE / CS script developed by Vladimir will resolve problems relating to the GOCDB site names,
should eventually be formulated as an agent. Eventually this will result in an addition to the CS site descriptions
containing subsections for each CE to describe the status. Roberto will send a mail to the sam list describing this
action.
- Action(83) - gLexec tests
Roberto is keeping an eye on the sites supporting the pilot role after the broadcast email (17 sites currently
supporting this role).
- Action(90) - Production Output Data parameter
Ongoing, added Stuart to this action point.
- Action(93) - Improve RAW data monitoring tools and status of files in online runDB
Ongoing.
- Action(94),(95),(96) - Service Monitoring
Roberto conveyed that the Dashboard presents a solution for the monitoring of the FTS transfer failures. Stuart
mentioned that the dashboard is a terminus of meaningful information and should be considered as a separate,
useful, tool for displaying data. The logger should be considered as a repository of errors from which we can begin to
automate notifications and actions for a plethora of activities ongoing in DIRAC. Since Andrew has already classified
the errors for the FTS example it was agreed to add his name to action point (94) in order to demonstrate the
functionality of the logging service. In parallel it was agreed that Roberto will pursue the publishing of this
information to the dashboard. After a problem with the CondDB SAM test Roberto removed the critical status, this
will be added again after observing for a week. Andrei suggested that the SRM tests provided by Andrew may need
some retries to account for transient problems, discussions on the criticality of these tests will be deferred to next
week.
- Action(106) - Ricardo - Produce twiki documentation for dirac-install
Ongoing, being prepared.
- Action(107) - Produce proposal for how to perform standardised installation using install_project/CMT
Ricardo will be coming to CERN this Friday to discuss these issues.
- Action(109) - Expose DataLogging interface on the web page
Ongoing.
- Action(111) - File merging productions
Ongoing, currently Alexey is concentrating on the request form.
- Action(113) - CS Documentation
Ongoing
- Action(115) - SAM Agent
Vladimir continues to work on client-side scripts as a first step to automating this action.
- Action(116) - CPU studies
Ricardo mentioned that studies continue on the 3080 and 3145 dummy productions and will hopefully report on this
later on in the week.
- Action(117) - Generic pilot site attribute
The other option is to use VO software tags and it was agreed to proceed in this way ensuring that tags can be
published remotely, using the DIRAC site name to guarantee the same picture for all relevant CEs listed in the CS.
- Action(118) - Provide script to demonstrate GFAL thread safety issue and submit a Savannah bug
Ongoing, Roberto will look through the CCRC logs and provide a non-DIRAC script to demonstrate the problem.
2. Production Status Report
- Report from the Production meeting
Stuart commented that some recent production requests e.g. for alignment are pending the next release of Gauss.
The lumi5 stripping is awaiting the next DIRAC release for using the new BK ancestor files functionality (as tested in
Development).
Roberto commented that there will be some upcoming Castor downtime and mentioned there was a renewed request
to retire the LCG RBs.
After some discussion it was decided to propose a roadmap for the retirement of DIRAC2 (including all the
implications for ongoing DC06 studies).
3. DIRAC3 Tasks
Ricardo mentioned that the optimizer updates are almost ready. The agent framework has been updated in order to
facilitate this. It was agreed to proceed with the release of DIRAC before the upcoming optimizer changes.
Andrei raised the point about memory consumption on volhcb09, apparently the hardware for the machine was not
sufficient to support the increase. A new machine would have to be requested in this case. The providers disagreed
with having 16GB of swap memory but this is requested due to the way in which python reserves memory. It was
agreed to make a request for a machine with the increased requirements with /opt/dirac as a separate partition (or as
a partition that can be increased depending on email discussions). If it is possible to have storage as a separate disk
this would improve performance. Joel will try to find out the possibilities and circulate a template.
Ricardo agreed to benchmark the behaviour of our services with python2.5 in development.
4. AOB
None
There are minutes attached to this event.
Show them.