Choose timezone
Your profile timezone:
PASTE meeting
Description
CERN, bat 2 R-030
To join the telephone conference, click here: https://audioconf.cern.ch/call/0165202
To dial in to the conference:
a. Dial +41 22 7676000
b. Enter access code 0165202
Production and PASTE Meeting, 5th August 2008, CERN
Chair: A.Tsaregorodtsev
Minutes: S. Paterson
CERN: M.Bargiotti, P.Charpentier, Z.Mathe, S.Paterson, R.Santinelli, V.Romanovsky
Phone: N.Brook, R.Graciani, R.Nandakumar, A.Tsaregorodtsev
Apologies: A.Casajus, A.C.Smith
0. Ongoing Action List
(07) - 27/11/07 - Zoltan, Elisa - Prototype bookkeeping system on volhcb07
(09) - 04/12/07 - Roberto, Marcos - Develop a general service monitoring framework leading to a virtual control room
(57) - 24/06/08 - Vladimir - Automatic publishing of BDII information in the CS using GOCDB site names
(59) - 22/07/08 - Ricardo - Add ldap python modules to DIRAC python distribution
(62) - 22/07/08 - Roberto - Check whether glite 3.1 comes with requested features/patches & coordinate upgrades
(63) - 22/07/08 - Roberto - Develop DIRAC3 script for adding new users to the VO + CS + LFC registration
(64) - 29/07/08 - Philippe, Andrew - Prepare SRMv1 retirement migration plan
(65) - 05/08/08 - Roberto - Define our SAM tests in the dashboard
(66) - 05/08/08 - Vladimir - Investigate interfaces to GOC DB for site downtime (c.f. ATLAS Dashboard)
(67) - 05/08/08 - Andrei - Test failover request forwarding mechanism
(68) - 05/08/08 - Zoltan - Migrate new BK from volhcb07 -> volhcb04
(00) - 05/08/08 - DIRAC developers - DIRAC3 (ongoing)
Completed Actions:
Done - (61) - 22/07/08 - Andrei - Investigate request generation problems in the workflows
1. Production Issues
- Action(07) - Prototype Bookkeeping
Zoltan is working on the graphical interface for the Bookkeeping. The service interface is completed.
- Action(09) - Virtual Control Room
No updates from Roberto. Sensor from Raja will be integrated this week.
Andrei commented that our SAM tests should be defined to the dashboard interface. ( ACTION: Roberto ) There was
some discussion regarding the site downtime notifications and the efforts to automate the gathering of this
information in ATLAS. The resolution of dates and times could be conveyed to a calendar but this does not further
analyse the messages. It was agreed to ask Vladimir to investigate these interfaces. ( ACTION: Vladimir )
- Action(57), (59) - Automatic publishing of BDII information in the CS
Vladimir is still waiting for the python ldap module to be added to the DIRAC python. Ricardo conveyed he would add
the ldap module to the development system such that Vladimir can proceed.
- Action(61) - Investigate workflow generation problems
Ricardo fixed the generation problem before the current production release.
It was commented that the request forwarding mechanism is still to be tested. ( ACTION: Andrei )
- Action(62) - Check whether glite 3.1 comes with requested features/patches & coordinate upgrades
The proxy role mixup problem still exists with the gLite 3.1 instance. A Savannah bug has been issued about this but
there is no response.
- Action(63) - DIRAC3 scripts for adding new users to the VO + CS + LFC registration
Roberto mentioned a prototype of this script was made available in bash but the DIRAC python script is pending. This
will be added to CVS after testing.
- Action(64) - Preprare SRMv1 retirement plan
Ongoing.
Stuart commented that a release of DIRAC3 will be made for the Ganga team and documentation added to the
webpage.
Marianne reduced the errors in the BK to 1.8K after cleaning up the CCRC requests. A couple of event types will be
removed from DC06 phys-v2-lumi2. Several leftover SIM requests for old productions were isolated but the failures
were difficult to understand due to the old Bookkeeping system.
There was a lot of discussion on the status of the request management system in DIRAC3. The testing of the request
forwarding mechanism and Request DB monitoring will be performed
Stuart reported that the CCRC activity is set to restart after Andrew confirmed successful testing on our side last
week. This will proceed at a low level to keep the motor running. In the coming weeks real commissioning data can
start to be used. Several 2008 Alignment production requests have been received, as mentioned at the production
operations meeting:
- Python options will be used for these requests (Gauss v35r0, Boole v16r0 and Brunel v33r1) and Gauss will be released this week
- SIM + DST files are to be saved (agreed to put SIM files into the RDST space tokens)
- Require simulation condition discovery mechanism from the Bookkeeping.
Andrei raised the issue of saving small numbers of SIM files at the beginning of normal productions and agreed to
check this logic in the job finalization module.
2. DIRAC3 Tasks
Ricardo confirmed that the production installations on volhcb09 and volhcb10 are in place. It was suggested to keep
volhcb03 to test the new Task Queue implementation. volhcb01 should be installed from CVS. There was some
discussion over the development priorities, it was agreed to install volhcb03 as another development machine for the
Task Queue optimization. Developers should be careful that there is no interference with volhcb03 changes. Problem
with committing files from volhcb03 was raised by Ricardo, this could indicate changes on the CVS servers but will be
discussed offline. Roberto agreed to follow this up with CVS support.
Define aliases to DIRAC hosts such that the CS can be populated with aliases, Andrei added a proposal to the agenda
page and will update this after discussions.
volhcb07 must be returned but is currently the prototype bookkeeping services. Since these services are not very
intensive they could be added to the DIRAC2 production machine, e.g. volhcb04. Zoltan was asked to migrate the
existing services there to volhcb04. ( ACTION: Zoltan )
Philippe mentioned that many useful pages are currently spread across several existing web sites. It would be
beneficial to integrate these existing links into the DIRAC3 web framework. Roberto mentioned that Jean-Philippe was
offering a web portal for the LFC at some point so we could benefit from that.
Stuart raised the point that the workflow modules require more testing flags to allow e.g. not polluting the catalogs
with test jobs, a proposal for this will be circulated.
Andrei mentioned that work has started on the production request form and this will initially be quite simple e.g. large
comment forms. The initial steps are to present a page linking the requests to the production IDs and then finally to
the number of events in the Bookkeeping.
3. AOB
There is an EGEE conference on 22nd September that nobody from DIRAC applied to, Andrei suggested that the pilot
note should be sent there. The deadline should be checked.
There are minutes attached to this event.
Show them.