Choose timezone
Your profile timezone:
PASTE meeting
Description
CERN, bat 2 R-030
To join the telephone conference, click here: https://audioconf.cern.ch/call/0165202
To dial in to the conference:
a. Dial +41 22 7676000
b. Enter access code 0165202
Production and PASTE Meeting, 28th October 2008, CERN
Chair: A.Tsaregorodtsev
Minutes: S. Paterson
CERN: S.Paterson, V.Romanovsky, A.C.Smith
Phone: N.Brook, A.Casajus, R.Graciani, M.Sapunov, A.Tsaregorodtsev, A.Zhelezov
Apologies: P.Charpentier, J.Closier, Z.Mathe, R.Santinelli
0. Ongoing Action List
(07) - 27/11/07 - Zoltan, Elisa - Ongoing new bookkeeping system development. Migration plan
(57) - 24/06/08 - Vladimir,Roberto - Automatic publishing of BDII / GOCDB information in the CS using GOCDB site names and provide a summary of recent changes
(82) - 01/09/08 - Andrei/Adri - to provide information from Accounting and WMS to allow GridMap for LHCb VO T1 activity
(83) - 01/09/08 - Stuart,Roberto - To perform glexec tests
(90) - 09/09/08 - Joel - Use new ProductionOutputData JDL parameter in modules instead of creating LFNs
(93) - 16/09/08 - Andrew - Improve RAW data monitoring tools and status of files in online runDB
(94) - 23/09/08 - Roberto, Marcos - Using SystemLogging service for dynamic services status monitoring
(95) - 23/09/08 - Roberto - SLS and SAM sensors development, upgrade SE tests with new DMS unit test
(96) - 23/09/08 - Roberto, Matvey - Dashboard SAM tests visualization, porting to DIRAC framework
(103) - 23/09/08 - Paul, Stuart - produce structured HTML version of the Shifter's guide
(106) - 30/09/08 - Ricardo - Produce twiki documentation for dirac-install
(107) - 30/09/08 - Ricardo/Philippe/Joel/Hubert/MarcoC - Produce proposal for how to perform standardised installation using install_project/CMT
(109) - 14/09/08 - Matvey - Expose DataLogging interface on the web page
(111) - 14/09/08 - Philippe - Update file merging proposal after email discussions (left open in case of further discussions)
(112) - 21/10/08 - Roberto, Marcos - Demonstrate benefits of the Logger service with a working example
(113) - 21/10/08 - Ricardo, Adri - Document the CS procedures for both the mechanism to define authorization rules in DIRAC and also the current group properties
(114) - 21/10/08 - Stuart - Investigate opening ports on volhcb02, volhcb01
(115) - 21/10/08 - Vladimir - Update SAM Agent to monitor and manage submitted jobs and publish results for faulty CEs to the SAM DB
1. Action Updates
- Action(07) - Prototype Bookkeeping
Zoltan is absent.
- Action(57) - Automatic publishing of BDII / GOCDB information in the CS
Ongoing. Describe procedures for the SAM jobs. ( ACTION: Vladimir )
- Action(82) - Provide accounting information to allow GridMap for LHCb VO T1 activity
Ongoing, data from the accounting and WMS job DBs is to be correlated.
- Action(83) - gLexec tests
Stuart mentioned that the current behaviour on the PPS WN for testing is always to map any proxy to an SGM
account. Maarten confirmed work is ongoing to support SCAS. There was some discussion on how to perform proxy
renewal with glexec and it was agreed to continue offline.
- Action(86) - Document job finalization policy
Ongoing.
- Action(90) - Production Output Data parameter
Ongoing. Stuart sent a mail regarding additional JDL parameters that have been added to help this migration.
- Action(93) - Improve RAW data monitoring tools and status of files in online runDB
Ongoing.
- Action(94) - SystemLogging
Last week there was some discussion regarding the use of the Logger and it was suggested to demonstrate at least
one example highlighting the benefits of this service. It was suggested to make this into an explicit action point for
next week. ( ACTION: Roberto, Marcos )
- Action(95) - SLS / SAM
Roberto retired the SRMv1 suite as discussed last week and removed the criticality of the related tests. For SRMv2
the tests are not currently taken into account for site availability. A new test using the Data Management components
is under preparation. SLS information is augmented with the URL of the service from the ping() method.
- Action(96) - Dashboard
Matvey did not yet receive the URL of the Dashboard information. Roberto will resend.
- Action(102) - Documenting the DIRAC Web portal installation on volhcb11
Action is closed, Matvey circulated an email.
- Action(103) - produce structured HTML version of the Shifter's guide
On hold due to the disk space restrictions on volhcb06.
- Action(106) - Ricardo - Produce twiki documentation for dirac-install
Ongoing, being prepared.
- Action(107) - Produce proposal for how to perform standardised installation using install_project/CMT
Ongoing.
- Action(109) - Expose DataLogging interface on the web page
Ongoing.
2. Production Status Report
- Report from the Production meeting
The FEST production is currently on hold pending the clearing up of the BK simulation condition problems. Recently
some sites were posing questions as to why requested resources are not being used. As a result Stuart created a test
production that uploads no data files and no BK reports but allows targetting of jobs to certain sites if desired.
No comments for 100% processing efficiency proposal, Stuart agreed to send a reminder.
- Putting in production v4r0 release
The v4r0 release is tagged and is imminent. Ricardo summarized that there were two main incompatibilities: dirac-
install is new and not backwards compatible due to an updated deployment of the scripts; the second is the updated
treatment of proxies to solve the gssklog and glexec issues. It was agreed to update volhcb 01, 06, 09 and 10 to the
latest release and Ricardo agreed to get in touch with Raja about upgrading the Tier-1 VO-boxes.
- Bookkeeping access rules
Stuart mentioned that there were many central services (including the BK) for which access rules are not defined. It
was suggested to document both the mechanism to define authorization rules in DIRAC and also the current group
properties. ( ACTION: Ricardo, Adri )
- Development system hosts
volhcb02 is now the current development machine after migration. In Joel's absence, Stuart will try to contact the
netops people at CERN.
3. DIRAC3 Tasks
- DIRAC installation
Will be documented on a twiki.
- glexec tests
Discussed above.
- Sandbox maintenance
Andrei mentioned that the current implementation is a single MySQL table which is growing. The proposed solution is
to put in place a partitioned schema that allows no more than 5GB per chunk. This should improve the maintenance
of the sandboxes.
- Job cleaning
After a sandbox is retrieved the suggestion is to mark that this is the case and allow a garbage collection of retrieved
sandboxes after a certain time as necessary. For deleted jobs the delay is zero, Done and Failed jobs are set to 2
weeks and Killed jobs for one week.
4. AOB
- CHEP abstracts
Reminder for deadline of mid-November.
There are minutes attached to this event.
Show them.