Choose timezone
Your profile timezone:
PASTE meeting
Description
CERN, bat 2 R-030
To join the telephone conference, click here: https://audioconf.cern.ch/call/0122882
To dial in to the conference:
a. Dial +41 22 7676000
b. Enter access code 0122882
Production and PASTE Meeting, 4th December 2007, CERN
Chair: A.Tsaregorodtsev
Minutes: S. Paterson
CERN: M.Bargiotti, G.Castellani, J.Closier, E.Lanciotti, S.Paterson, R.Santinelli, A.C.Smith,
Phone: R.Bernet, G.Kuznetszov, U.Marconi, M.A.S.Miguelez, M.Sapunov, A.Tsaregorodtsev
Apologies: N.Brook, P.Charpentier, R.Nandakumar
0. Ongoing Action List
30/10/07 - Marianne - Check number of events for prod 1957 in BK against LFC
30/10/07 - Marianne - Update of LFC replica flags (C checked, N checked but not present)
06/11/07 - Gianluca, Marianne - Remedy the Exceeded Max Staging Retry jobs and update ProcDB as required
06/11/07 - Gianluca, Marianne - Agents for automatic resolution of IntegrityDB entries should be developed
13/11/07 - Roberto - Contact ATLAS representative to understand VOMS usage in other VOs
13/11/07 - Marianne - RAL and PIC migrations, FTS job submissions
27/11/07 - Roberto - Redesign LFC intervention plan for upgrade to latest version
27/11/07 - Andrei - Prepare draft pilot document as internal LHCb note
27/11/07 - Marianne - Investigate discrepancy of events for productions 1960 and 1962
27/11/07 - Elisa, Marianne - Prototype bookkeeping with API wrapped in DISET service
04/12/07 - Marianne, Andrei - Bookkeeping should be updated to runit instead of init.d startup scripts
04/12/07 - Alexei, Andrei - Further investigate cause of sporadic failures at GridKa for production jobs
04/12/07 - Gianluca, Roberto - Prepare an SRM sensor test for the LHCb SAM framework
04/12/07 - Gianluca - Report problematic CERN tapes to the Castor support team
04/12/07 - Joel, Andrei, Andrew - Report on upgrade / retirement of older LHCb machines
04/12/07 - DIRAC developers - DIRAC3 (ongoing)
Completed Actions
Done - 23/10/07 - Marianne - Request for basic documentation for restarting the Bookkeeping services
Done - 27/11/07 - Andrew - Make proposal for CS SRM2 SE definitions
1. Production Status Report
Minutes from the production meeting are available here.
Gianluca reported that 1991-3 are completed. 2000-1 are ongoing but the files are staging and 10-20% are failing
with exceeded maximum staging retry. There was a problem at NIKHEF due to the mapping of Joel's credential at the
site but this has now been resolved. Roberto and Gianluca are to prepare an SRM sensor test for SAM. ( ACTION:
Gianluca, Roberto ) Problems with a missing library for Boole were found at Zurich by Roland. Joel commented about
the data sanity agent reports that are showing many blocked tapes at CERN, this should be conveyed to the Castor
support team. ( ACTION: Gianluca). Joel also reported that for the stripping all jobs have been submitted to 4 of the
Tier-1 sites but jobs for the remaining 3 are pending end of downtime etc.
Alexei has tracked down the problem with sporadic failures at GridKa relating to the LD_LIBRARY_PATH and Andrei
agreed to investigate this further with Alexei. ( ACTION: Andrei )
2. Production Operations Issues
- v2r18p1 release
Andrei compiled the v2r18p1 release with a bug fix in the Transfer Agent. Raja has installed this release on all the
VO-boxes.
- volhcb01 -> volhcb05 migration
The user system has been migrated to volhcb05 and users have transparently started using this machine. Joel was
asked to investigate whether a 1TB local disk could be added to this machine.
volhcb01 should be upgraded to SLC4 and the large local disk still be used to store the log files. ( ACTION: Joel ) For
the older machines:
- lxgate03 - upgrade to SLC4 without touching the DIRAC installation after Andrei checks the location of the databases ( ACTION: Andrei )
- lxgate05 - can be renamed to volhcb06 ( ACTION: Joel )
- lxgate34 - Andrew should confirm the status of this machine ( ACTION: Andrew )
- lbnts2 - can be retired.
- Bookkeeping services on volhcb05 ( LFC access )
Currently the BK is running on volhcb01 so this cannot be upgraded until the switchover to volhcb05. This is ongoing
but will occur when the LFC access problems for the BK are resolved. After the migration, volhcb01 will become the
BK prototyping machine. Andrei suggested migrating the startup scripts to use runit (to be consistent with other
DIRAC services) such that the Grid environment can be setup. ( ACTION: Marianne, Andrei )
- RAL migration
After yesterday's intervention in dCache the FTS channels were not reactivated. Migration is therefore currently
on-hold.
- PIC migration
The PIC migration for disk will be complete whenever submitted requests are satisfied. There are problems for
migration of tape-resident files and this is ongoing.
3. DIRAC3
Stuart reported that a working Job Agent and Job Wrapper are in place and effort will go into the Pilot script and Agent
Director. Joel has made the dirac-install and dirac-setup scripts available in CVS. A problem was reported to Gennady
with recreating workflows from XML and is being investigated. The full chain of execution is almost in place so DIRAC3
will be used to perform SRM2 tests. Joel has a version of the GaudiApplication module working with python options
and is continuing with dual support for options in the same module.
4. AOB
Andrei will compile a DIRAC overview abstract for the EGEE User Forum since the deadline is now for 10th December.
There are minutes attached to this event.
Show them.