Production and PASTE Meeting, 27th October 2009, CERN
Chair: A.Tsaregorodtsev
Minutes: S.Paterson
CERN: Z.Mathe, S.Paterson, M.Rashid, R.Santinelli, A.C.Smith, F.Stagni
Phone: V.Fernandez, R.Graciani, R.Nandakumar, V.Romanovsky, M.Sapunov, A.Tsaregorodtsev, A.Zhelezov
Apologies: P.Charpentier, J.Closier
0. Ongoing Action List
#10918 - Ricardo commented that the certification machine is almost ready. It was agreed to also install the data
management components there.
#10919 - Pending an update from Joel regarding the current machine warranty expiration versus SLC4 retirement
#11223 - Direct submission to CREAM CE can now be tested at some sites (using volhcb06 as a GridFTP server for testing)
#11124 - SVN repository testing, in order to support existing LHCb tools Marco Cl. confirmed the structure of the
repository must be different. After some discussion it was agreed to pursue other compromise solutions
1. Production Status Report
- Report from the Production meeting
FEST stripping and reco-stripping workflows were commissioned last week (see FEST ELOG). Recent problem of
productions defined with incorrect event type comes from request definition, we need to impose a tighter coupling
between the simulation conditions and the options files in the processing pass in the future.
- Jobs in short queues in CC/IN2P3
Ricardo will dig out some pilot JDLs, under investigation.
- Lemon sensors/alarms for DIRAC services
Roberto asked whether LHCb is wanting to exploit the 24/7 coverage provided by Lemon. These sensors have been
successfully deployed at the system level and it was agreed to extend the functionality to catch situations where e.g.
no swap space is available such that the DIRAC experts can be notified prior to a situation becoming terminal.
Roberto agreed to investigate a list of hardware conditions to monitor and possible actions to take starting from the
existing Lemon sensor tests. ( ACTION: Roberto )
FIO conveyed that the mechanism for interrogating the bqueues was quite heavy, this will be checked in the timeleft utility.
2. DIRAC Release Update
The v4r20 release notes are available and Andrei will proceed to release this for central machines and pilots.
3. DIRAC Tasks
- Infrastructure monitoring (SAM,SLS,Dashboard)
Space token disk occupancy, including pledge information is now available in a table. It was suggested to convey the
recipe for obtaining this information to Matvey such that a DIRAC portal page can be constructed. SAM tests are not
yet fully translated into Nagios probes but this has been demonstrated. The XML descriptor of our topology of tests
and services is being prepared. Federico exposed a method to start publishing information on site-level web pages
and is waiting for Matvey to create a prototype.
- Bookkeeping status
All new features are present in v4r20. These include the run lookup and the propagation of run numbers to
descendent files. Also automatic counting of event input statistics in case it is not provided.
- WMS status
Support for CREAM submission via the WMS was added in v4r20. Stuart reported that the BK ancestor files optimizer
functionality was resurrected.
- DMS status
Andrew updated the SRM2 plugin to allow to list large directories using gfal. Large productions going through
validation of output data were becoming stuck due to this. The production management transformation agent is now
equipped with 'by run' plugins. File migration monitoring is added for T1D0 uploads, this will be integrated with the
stager. A script has been developed to create web pages from a database table, this is not yet released but will be
shortly.
- Production Management status
Alexey mentioned that there will be simplifications for browsing requests on the request page.
- Services deployment ( hardware, configuration )
Discussed above.
4. AOB
None
There are minutes attached to this event.
Show them.