Choose timezone
Your profile timezone:
PASTE meeting
→
Europe/Zurich
2-R-014 (CERN)
2-R-014
CERN
Description
CERN, bat 2 R-014
To join the telephone conference, click here: https://audioconf.cern.ch/call/0165202
To dial in to the conference:
a. Dial +41 22 7676000
b. Enter access code 0165202
Production and PASTE Meeting, 20th January 2009, CERN
Chair: A.Tsaregorodtsev
Minutes: S. Paterson
CERN: P.Charpentier, J.Closier, Z.Mathe, S.Paterson, M.Rashid, V.Romanovsky, R.Santinelli, A.C.Smith
Phone: N.Brook, R.Graciani, M.Sapunov, A.Tsaregorodtsev, A.Zhelezov
Apologies:
0. Ongoing Action List
(07) - 27/11/07 - Zoltan - Ongoing new bookkeeping system development. BK dataset queries.
(57) - 24/06/08 - Vladimir,Roberto - Automatic publishing of BDII / GOCDB information in the CS using GOCDB site names and provide a summary of recent changes
(83) - 01/09/08 - Stuart,Roberto - To perform glexec tests (pending SCAS certification)
(90) - 09/09/08 - Joel,Stuart - Use new ProductionOutputData JDL parameter in modules instead of creating LFNs
(93) - 16/09/08 - Andrew - Improve RAW data monitoring tools and status of files in online runDB
(94) - 23/09/08 - Andrew, Marcos - Using SystemLogging service for dynamic services status monitoring (Andrew to provide FTS example)
(95) - 23/09/08 - Roberto - SLS and SAM sensors development, upgrade SE tests with new DMS unit test
(96) - 23/09/08 - Roberto - Update Dashboard SAM tests visualization, GOCDB / DIRAC site name mappings
(106) - 30/09/08 - Ricardo - Produce twiki documentation for dirac-install
(107) - 30/09/08 - Ricardo,Philippe,Joel,Hubert,MarcoC - Produce proposal for how to perform standardised installation using install_project/CMT
(109) - 14/09/08 - Matvey,Andrew - Expose DataLogging interface on the web page
(111) - 14/09/08 - Philippe,Alexei,Andrei - Productions with file merging and associated data distribution implementation
(113) - 21/10/08 - Ricardo, Adri - Document the CS procedures for both the mechanism to define authorization rules in DIRAC and also the current group properties
(116) - 18/11/08 - Ricardo - Circulate a report on the recent Gauss CPU studies, steer the CPU related activities in DIRAC
(117) - 18/11/08 - Ricardo - Add a site attribute to reflect whether generic pilots are accepted there, update the Director
(120) - 16/12/08 - Ricardo - Update TQ Director to deal with a mixture of generic / private pilots at sites
(121) - 16/12/08 - Andrei, Alexey - Add production extensions to logging information (pending release)
(122) - 13/01/09 - Ricardo - Develop specialized SAM pilot director to submit, track and report errors with regard to pilots
(123) - 13/01/09 - Joel - Clean up VOMS(RS) to ensure all users have consistent roles in VOMS
(124) - 20/01/09 - Stuart - Apply dataset limit sanity check for user jobs (limit to 100) to client side e.g. LHCbJob
(125) - 20/01/09 - Alexey - Production request GUI progress
(126) - 20/01/09 - Andrei - Document the design of the workflow / production management components
(127) - 20/01/09 - Ricardo - Investigate feasibility of supporting multiple DNs in DIRAC only for use-case of DN change
Completed Actions:
Done - (115) - 21/10/08 - Vladimir,Matvey - Update SAM Agent to monitor and manage submitted jobs and publish results for faulty CEs to the SAM DB
1. Action Updates
- Action(07) - Prototype Bookkeeping
Zoltan is preparing the new methods for automating the processing pass insertion and will require a new release of
DIRAC for client and server. The GUI has also been updated, Matvey is also working on the web GUI and this is still
being perfected.
- Action(57) - Automatic publishing of BDII / GOCDB information in the CS
Roberto summarized the the recommendations circulated in an email prior to PASTE. The definition of 'sub-clusters'
seems less relevant for us since primarily this is used to determine the capacity of sites.
- Action(83) - gLexec tests
Nothing new to report, SCAS is still under certification. There has not been a great deal of progress regarding the
deployment of the pilot role.
- Action(90) - Production Output Data parameter
Ongoing.
- Action(93) - Improve RAW data monitoring tools and status of files in online runDB
Ongoing.
- Action(94) - SystemLoggingDB example
Ongoing.
- Action(95),(96) - Service Monitoring
SAM SLS development is ongoing. Feedback was sent to the Dashboard developers.
- Action(106) - Ricardo - Produce twiki documentation for dirac-install
Ongoing.
- Action(107) - Produce proposal for how to perform standardised installation using install_project/CMT
Some developments have been pending the next release of DIRAC.
- Action(109) - Expose DataLogging interface on the web page
Ongoing.
- Action(111) - File merging productions
Ongoing.
- Action(113) - CS Documentation
Ongoing.
- Action(115) - SAM Agent
This was committed to CVS and is pending the next DIRAC release.
- Action(116) - CPU studies
Ricardo has the numbers and will publish the results in the CS.
- Action(117) - Generic pilot site attribute
Ongoing.
- Action(120) - Update TQ Director to deal with a mixture of generic / private pilots at sites
Ongoing.
- Action(121) - Add production extensions to logging information
Just pending the next DIRAC release.
- Action(124) - Apply dataset limit check
Stuart applied this to the
- Action(125) - Production Request GUI
Alexey mentioned that the prototype of the production request page should be available next week.
Philippe raised the issue of having one DN per user in the VO. It was agreed that Ricardo will investigate the
feasibility of supporting multiple DNs in the VO only for the temporary case of a DN change. ( ACTION: Ricardo ) Joel
will clean up VOMS(RS) to ensure all user credentials have the same roles, see Action(123).
2. Production Status Report
- Report from the Production meeting:
Stuart conveyed that the main issue at the moment was the possibility to modify the priority of a given production
(and a given job) post-submission. Still pending the fix for stale NFS file handles from core software. The most
pressing operational issue was the shared area at CNAF being unusable.
As a reminder the list of ongoing FEST preparations is below:
- BK query population of datasets
- Finalize derived production mechanism
- Optimizations for the creation of jobs (for productions with input data)
- Expose production priority boosting mechanism via production API
- Introduce refined status machine to allow archiving of productions
- Introduce a ProductionGroup parameter to improve monitoring (analogous to JobGroup).
The latest prototype of the pilot summary page is available on lhcbtest, comments to Andrei are welcome.
3. Project responsibilities
Philippe attached a document to the agenda page describing the breakdown of responsibilities.
4. DIRAC3 Tasks
Andrei's summary of the outstanding tasks after the Christmas post-mortem (reminder from last week):
- Bulk job submission for production and user jobs
- Tuning of pilot submissions (see below)
- Memory consumption of JobStateUpdate is a limiting factor
- Optimizations in job wrapper and on the service side via decoupling the heartbeats
- Pilot summary page is a good indicator of how well a site is functioning, this should be tuned
- Simple plots such as in DIRAC2 should be made available in DIRAC3
- Timeleft utility would be useful for preventing stalled jobs
5. AOB
Meeting closed at 12:47 (lunch needed).
There are minutes attached to this event.
Show them.