Choose timezone
Your profile timezone:
PASTE meeting
→
Europe/Zurich
2-R-014 (CERN)
2-R-014
CERN
Description
CERN, bat 2 R-014
To join the telephone conference, click here: https://audioconf.cern.ch/call/0165202
To dial in to the conference:
a. Dial +41 22 7676000
b. Enter access code 0165202
Production and PASTE Meeting, 6th January 2009, CERN
Chair: A.Tsaregorodtsev
Minutes: S.Paterson
CERN: P.Charpentier, J.Closier, S.Paterson, A.C.Smith
Phone: M.Sapunov, A.Tsaregorodtsev
Apologies: Z.Mathe, R.Santinelli
0. Ongoing Action List
(07) - 27/11/07 - Zoltan - Ongoing new bookkeeping system development. BK dataset queries.
(57) - 24/06/08 - Vladimir,Roberto - Automatic publishing of BDII / GOCDB information in the CS using GOCDB site names and provide a summary of recent changes
(83) - 01/09/08 - Stuart,Roberto - To perform glexec tests (pending SCAS certification)
(90) - 09/09/08 - Joel,Stuart - Use new ProductionOutputData JDL parameter in modules instead of creating LFNs
(93) - 16/09/08 - Andrew - Improve RAW data monitoring tools and status of files in online runDB
(94) - 23/09/08 - Andrew, Marcos - Using SystemLogging service for dynamic services status monitoring (Andrew to provide FTS example)
(95) - 23/09/08 - Roberto - SLS and SAM sensors development, upgrade SE tests with new DMS unit test
(96) - 23/09/08 - Roberto - Update Dashboard SAM tests visualization
(106) - 30/09/08 - Ricardo - Produce twiki documentation for dirac-install
(107) - 30/09/08 - Ricardo,Philippe,Joel,Hubert,MarcoC - Produce proposal for how to perform standardised installation using install_project/CMT
(109) - 14/09/08 - Matvey,Andrew - Expose DataLogging interface on the web page
(111) - 14/09/08 - Philippe,Alexei,Andrei - Productions with file merging and associated data distribution implementation
(113) - 21/10/08 - Ricardo, Adri - Document the CS procedures for both the mechanism to define authorization rules in DIRAC and also the current group properties
(115) - 21/10/08 - Vladimir,Matvey - Update SAM Agent to monitor and manage submitted jobs and publish results for faulty CEs to the SAM DB
(116) - 18/11/08 - Ricardo - Circulate a report on the recent Gauss CPU studies, steer the CPU related activities in DIRAC
(117) - 18/11/08 - Ricardo - Add a site attribute to reflect whether generic pilots are accepted there, update the Director
(120) - 16/12/08 - Ricardo - Update TQ Director to deal with a mixture of generic / private pilots at sites
(121) - 16/12/08 - Andrei, Alexey - Add production extensions to logging information (pending release)
Completed Actions:
Done - (119) - 16/12/08 - Stuart - Recreate dummy production with updated workflow lib
1. Action Updates
- Action(07) - Prototype Bookkeeping
Zoltan is away until the end of the week. Philippe mentioned that there was an issue with retrieving ancestor files
with the current BK client, this is to be investigated. The most pressing issue for the BK is how to formulate the BK
queries.
- Action(57) - Automatic publishing of BDII / GOCDB information in the CS
Roberto mentioned that the document was attached to the last meeting agenda with some action points.
- Action(83) - gLexec tests
Nothing new to report, SCAS is still under certification.
- Action(90) - Production Output Data parameter
Ongoing, will try to make progress this afternoon.
- Action(93),(94) - Improve RAW data monitoring tools and status of files in online runDB
Ongoing.
- Action(95),(96) - Service Monitoring
Roberto is absent this week.
- Action(106) - Ricardo - Produce twiki documentation for dirac-install
Ongoing, being prepared.
- Action(107) - Produce proposal for how to perform standardised installation using install_project/CMT
The subset of dependents from the LHCbGrid project that are required for DIRAC can now be installed via
install_project. A v* will be added to the LHCbGrid / DIRAC CMT requirements. Andrei agreed to add the DIRAC v4r4
release notes to the ELOG and this version of the client will be installed on lxplus.
- Action(109) - Expose DataLogging interface on the web page
Ongoing.
- Action(111) - File merging productions
Ongoing.
- Action(113) - CS Documentation
Ongoing.
- Action(115) - SAM Agent
As reported at the operations meeting, Vladimir made some progress on this over the Christmas break and will
commit this agent soon.
- Action(116) - CPU studies
In order to deploy the filling mode we still require a benchmarking factor for the local CPU, Ricardo is working on this.
- Action(117) - Generic pilot site attribute
Ongoing.
- Action(120) - Update TQ Director to deal with a mixture of generic / private pilots at sites
Ongoing.
- Action(121) - Add production extensions to logging information
This is committed but not yet released.
2. Production Status Report
- Stuart mentioned that the following issues are most urgent for the FEST:
- BK query population of datasets
- Finalize derived production mechanism
- Optimizations for the creation of jobs (for productions with input data)
- Expose production priority boosting mechanism via production API
- Introduce refined status machine to allow archiving of productions
- Introduce a ProductionGroup parameter to improve monitoring (analogous to JobGroup).
The recent failures relating to Geant4 exceptions highlighted the need for a dictionary of error strings from project
responsibles, this will be mentioned at the Core Software meeting.
3. DIRAC3 Tasks
Most of the DIRAC3 tasks are mentioned above.
Visualization of Task Queues on the monitoring portal would also be advantageous e.g. TQ requirements, summary of
pilots, number of jobs etc.
4. AOB
The CHEP09 agenda page should be updated with the contribution type.
There are minutes attached to this event.
Show them.