Choose timezone
Your profile timezone:
PASTE meeting
Description
CERN, bat 2 R-030
To join the telephone conference, click here: https://audioconf.cern.ch/call/0165202
To dial in to the conference:
a. Dial +41 22 7676000
b. Enter access code 0165202
Production and PASTE Meeting, 27th May 2008, CERN
Chair: A.Tsaregorodtsev
Minutes: S. Paterson
CERN: G.Castellani, P.Charpentier, J.Closier, Z.Mathe, M.A.S.Miguelez, S.Paterson, R.Santinelli, A.C.Smith
Phone: N.Brook, R.Graciani, R.Nandakumar, M.Sapunov, A.Tsaregorodtsev
Apologies:
0. Ongoing Action List
(01) - 06/11/07 - Gianluca, Marianne, Joel - Remedy the Exceeded Max Staging Retry jobs and update ProcDB via development of Agents to resolve this
(04) - 13/11/07 - Marianne, Andrew - RAL, FTS job submissions
(07) - 27/11/07 - Zoltan, Elisa, Marianne - Prototype bookkeeping system on volhcb07
(09) - 04/12/07 - Roberto, Marcos, Gianluca - Develop a general service monitoring framework leading to a virtual control room
(27) - 08/01/08 - Andrew - Backup DMS services on lxgate34 to allow migration to SLC4, port IntegrityDB to DIRAC3
(55) - 08/04/08 - Marianne - Recover data that failed to be registered in the BK DB
(56) - 29/04/08 - Roland, Stuart, Joel - Provide Production Manager guide
(58) - 13/05/08 - Roberto, Joel - Resolve issue with shared area at LCG.Brunel.uk
(59) - 13/05/08 - Andrei, Angelo - Check StoRM SE definition in DIRAC2
(60) - 13/05/08 - Andrei - Add LFC synchronization to addDirectory call
(00) - 27/05/08 - DIRAC developers - DIRAC3 (ongoing)
Completed Actions
Done - (59) - 13/05/08 - Andrei, Angelo - Check StoRM SE definition in DIRAC2
1. CCRC Status
Nick agreed to take minutes for this session and post them to the LHCb CCRC'08 ELOG.
2. Production Status Report
Minutes from the production meeting are available here.
- ProcDB update - Action(01)
Gianluca restarted the agent and this is running over the exceeded maximum staging retries and reschedulings
reached jobs.
- RAL Migration - Action(04)
Andrew conveyed around 13 tapes were remaining (no change since last week) mostly due to the tape system in
dCache frequently falling over. There was some discussion regarding the delay to the DC06 processing jobs that have
been created for RAL, the agreed solution was to wait until the migration completes before proceeding with these
jobs.
- Bookkeeping prototype - Action(07)
Zoltan is currently preparing documentation and a presentation for the recently explored strategies in the
Bookkeeping. A meeting with the Online team is scheduled in order to understand which metadata is important to
populate the Bookkeeping with. It was agreed to start populating the new Bookkeeping DB from the JobFinalization
module.
- Monitoring framework - Action(09) & Action(61)
Roberto has added a SAM test for LHCb VO services for SE space token descriptions and this is currently being
debugged. Roberto got in touch with Julia about providing an LHCb prototype of the SAM visualization tool, add
Action(61) to Action(09). The prototype for service monitoring is in place but these sensors can be complemented
with lots of additional information. Andrei suggested scheduling a meeting during the DIRAC3 week to discuss this.
- Backup DMS services on lxgate34, port IntegrityDB to DIRAC3 - Action(27)
Ongoing. There are 27k entries remaining in the DB. Gianluca was asked to formulate the cases for the problematic
files and propose solutions to these problems via the developers list. Philippe mentioned the mail from Olof
regarding ~7k problematic files on CERN Castor and highlighted that the procedures for dealing with this situation
should be defined and carried out.
- Recover data that failed to be registered in the Bookkeeping - Action(55)
Marianne is absent. There was some discussion regarding the failed registrations in the bookkeeping that lead to
subsequent files not being added. It was suggested to relax the check on whether file inputs are in the BK in order to
easily recover the files created from them. Philippe will formulate an email to propose the course of action.
- Production Manager Guide - Action(56)
It was decided to try to make progress on this during the DIRAC3 week.
- Resolve Brunel shared area - Action(58)
GGUS ticket still open but Roberto agreed to update it accordingly.
- Add LFC synchronization to addDirectory call - Action(60)
Philippe didn't have a chance to test this but will confirm the status after testing the fixes put in place by Andrei.
3. Production Operations Issues
- DC06 Productions Progress
See above, several jobs have been recovered and submitted. Gianluca was urged to ban IN2P3 in the user system.
- volhcb02 reboot
MySQL was not restarted after the recent reboot of volhcb02. Ricardo agreed to investigate.
4. DIRAC3 Tasks
Joel was asked to test the updated workflow modules, Andrei will prepare a description of these to allow testing to
proceed. There was some preliminary discussion on how to proceed with sustained activity during June but this will
be discussed post-CCRC phase2. For other issues, see CCRC'08 minutes.
5. AOB
None.
There are minutes attached to this event.
Show them.