Choose timezone
Your profile timezone:
PASTE meeting
Description
CERN, bat 2 R-030
To join the telephone conference, click here: https://audioconf.cern.ch/call/0165202
To dial in to the conference:
a. Dial +41 22 7676000
b. Enter access code 0165202
Production and PASTE Meeting, 16th September 2008, CERN
Chair: A.Tsaregorodtsev
Minutes: S. Paterson
CERN: J.Closier, Z.Mathe, S.Paterson, V.Romanovsky, E.Rondan, R.Santinelli, M.Sapunov, A.Tsaregorodtsev
Phone: R.Bernet, N.Brook, R.Graciani, R.Nandakumar
Apologies: P.Charpentier, A.C.Smith
0. Ongoing Action List
(07) - 27/11/07 - Zoltan, Elisa - Prototype bookkeeping system, roadmap for production
(09) - 04/12/07 - Roberto, Marcos - Develop a general service monitoring framework leading to a virtual control room
(57) - 24/06/08 - Vladimir,Roberto - Automatic publishing of BDII / GOCDB information in the CS using GOCDB site names and provide a summary of recent changes
(70) - 12/08/08 - Joel,Ricardo - Perform and document DIRAC3 installation in the LHCb release area at CERN with accessible CS file (Ricardo to update the install script for LCG tag)
(79) - 26/08/08 - Andrei, Vladimir - Update CS to use new host aliases
(80) - 26/08/08 - Stuart/Philippe - Update DIRAC2 Stager for SRMv1->v2 migration
(82) - 01/09/08 - Ricardo/Adri - to provide information from accounting to allow GridMap for LHCb VO T1 activity
(83) - 01/09/08 - Stuart,Roberto - To perform glexec tests
(85) - 09/09/08 - Zoltan - Define authorization rules for BK interface methods
(86) - 09/09/08 - Andrei - Document the job finalization output data upload policy
(88) - 09/09/08 - Matvey - Provide improved RequestMonitoring interface in lhcbweb
(90) - 09/09/08 - Joel - Use new ProductionOutputData JDL parameter in modules instead of creating LFNs
(92) - 16/09/08 - Ricardo - Add publishing of information to batch monitoring tool
(93) - 16/09/08 - Andrew - Improve RAW data monitoring tools
Completed Actions:
Done - (63) - 22/07/08 - Roberto,Joel - Develop DIRAC3 script for adding new users to the VO + CS + LFC registration
Done - (71) - 19/08/08 - Andrei,Stuart - Add comment field to mask operations and formulate procedure
Done - (87) - 09/09/08 - Stuart - Proceed with testing xrootd at NIKHEF
Done - (89) - 09/09/08 - Stuart - Add production LFNs to production job JDL on client side
Done - (91) - 09/09/08 - Andrei - Create LHCbSystem agent to populate logSE with standard output / error
1. Action Updates
- Action(07) - Prototype Bookkeeping
The processing pass implementation continues in parallel to the GUI development.
- Action(09) - Virtual Control Room
Roberto implemented the CondDB sensor in the SAM framework, the code from Marco is tied to the CERN
environment but is being extended to run at all Tier-1s. The sensor will continue to be developed in order to check
the consistency of published information. Extracting information from the logging system regarding the StagerSystem
is the next step and Roberto is meeting Marcos later in the day.
- Action(57) - Automatic publishing of BDII information in the CS
The Russian and UK sites were updated after a consistency check with the BDII, Vladimir was asked to produce a
summary of the changes. Roberto commented that very old CEs at CERN were still in the CS so there are some
advantages to automatically refreshing the CS information. After some discussion it was agreed to proceed by
keeping existing information up to date rather than adding new information there (at least until we consider moving to
direct CE submission). Merged with Action(72) GOCDB / BDII Inconsistencies.
- Action(63) - DIRAC3 scripts for adding new users to the VO + CS + LFC registration
Joel committed the script in LHCb CVS this morning and it is in the LHCb python directory, action closed.
- Action(69) - Single user account for SGM user
After discussion at the MB level there are some security concerns with static accounts so it was agreed to continue to
put protection in place on our side (install_project) for the pool accounts. ( ACTION: Hubert ) Philippe will prepare a
summary of the difficulties for the MB ( ACTION: Philippe ).
- Action(70) - DIRAC3 installation in the LHCb release area at CERN
Joel asked Ricardo whether the LCG tag can be accepted as an installation parameter, Ricardo agreed to do this. (
ACTION: Ricardo) Reminder: last week it was agreed to enable write permission to the DIRAC configuration file for
the DIRAC developers in case of emergencies. Some documentation about the final procedure should be prepared.
- Action(82) - Provide accounting information to allow GridMap for LHCb VO T1 activity
Ricardo reported that Adri has been updating the accounting to facilitate this.
- Action(83) - gLexec tests
Stuart had no time to do this so far but with Roberto
- Action(85) - Authorization rules for BK interface
Ongoing.
- Action(86) - Document job finalization output data policy
Ongoing.
- Action(87) - Test xrootd at NIKHEF
Stuart mentioned that we have been using xrootd at NIKHEF for the past week and a procedure has been written to
explain how to modify the protocol list for a given site. Nick conveyed the outcomes of some discussions regarding
NIKHEF and it was understood that the site configuration was incorrect.
- Action(88) - Provide improved RequestMonitoring interface in lhcbweb
Matvey confirmed the new interface is available on lhcbtest but this will be improved in terms of additional selections.
It was agreed to update lhcbweb now with the currently available improvements.
- Action(89) - Construct production output LFNs on the client side to allow visual inspection
Stuart mentioned this functionality was recently added and the recent jobs for production 3034 have the
ProductionOutputData JDL parameter.
- Action(91) - Population of LogSE with standard output
Andrei commented that this is running in production and full outputs are now conveyed to the LogSE.
Ricardo was asked to add the publishing of information to the new batch monitoring tool available at CERN. ( ACTION:
Ricardo )
2. Production Status Report
Stuart reported that after some firefighting with the new release of DIRAC the old functionality has been restored.
The main priority at the moment is to develop tools to ensure 100% processing of files for reconstruction / stripping
productions. A dummy MC production (3034) has also successfully been commissioned, this uploads the final DST file
to the RDST space tokens. CCRC stripping is pending and there are two MC DC06 Stripping requests pending the
commissioning of the workflow. Yesterday many production requests were received for the commissioning of the
latest Gauss release, work will start on these over the coming days.
Nick asked about the progress with registering files from the pit in the catalogs. Andrei mentioned that the migration
confirmation requests were being sent after some problems last week.
After recent experience with a missing real data file on Castor it was agreed to make a longer term action on adding
to the RAW data monitoring tools. To be discussed when Andrew is back ( ACTION: Andrew ) Andrei conveyed that
the recent release notes for DIRAC are on the ELOG.
3. DIRAC3 Tasks
- SystemLogging reports
The top 10 errors will shortly be added to the web interface and these should be closely watched to ensure all are
relevant.
- Web portal feature requests
Since several useful improvements have recently been made, Matvey will make a release of the web interface to
lhcbweb.
4. AOB
None
There are minutes attached to this event.
Show them.