PASTE meeting

Tuesday 13 May 2008, 09:30 → 13:15 Europe/Zurich

1/1-025 (CERN)

Andrei Tsaregorodtsev

CERN, bat 2 R-030 To join the telephone conference, click here: https://audioconf.cern.ch/call/0165202 To dial in to the conference: a. Dial +41 22 7676000 b. Enter access code 0165202

Production and PASTE Meeting, 13th May 2008, CERN Chair: A.Tsaregorodtsev Minutes: S. Paterson CERN: P.Charpentier, J.Closier, E.Lanciotti, U.Marconi, Z.Mathe, S.Paterson, D.Perego, R.Santinelli, A.C.Smith Phone: N.Brook, R.Graciani, A.Tsaregorodtsev Apologies: M.Bargiotti, G.Castellani 0. Ongoing Action List (01) - 06/11/07 - Gianluca, Marianne, Joel - Remedy the Exceeded Max Staging Retry jobs and update ProcDB via development of Agents to resolve this (04) - 13/11/07 - Marianne, Andrew - RAL, FTS job submissions (07) - 27/11/07 - Zoltan, Elisa, Marianne - Prototype bookkeeping system on volhcb07 (09) - 04/12/07 - Roberto, Marcos, Gianluca - Develop a general service monitoring framework leading to a virtual control room (27) - 08/01/08 - Andrew - Backup DMS services on lxgate34 to allow migration to SLC4, port IntegrityDB to DIRAC3 (55) - 08/04/08 - Marianne - Recover data that failed to be registered in the BK DB (56) - 29/04/08 - Roland, Stuart, Joel - Provide Production Manager guide (57) - 13/05/08 - Roberto - Check the DIRAC3 service status reporting on the GridMap page (58) - 13/05/08 - Joel - Resolve issue with shared area at LCG.Brunel.uk (59) - 13/05/08 - Andrei, Angelo - Check StoRM SE definition in DIRAC2 (60) - 13/05/08 - Andrei - Add LFC synchronization to addDirectory call (00) - 13/05/08 - DIRAC developers - DIRAC3 (ongoing) 1. CCRC Status Nick agreed to take minutes for this session and post them to the LHCb CCRC'08 ELOG. 2. Production Status Report Minutes from the production meeting are available here. - RAL Migration - Action(04) Andrew reported some difficulties with bringing files online using the dCache at RAL. Raja is in the loop and is chasing the local contacts at RAL. - Bookkeeping prototype - Action(07) Elisa reported that it is feasible to write into the new and old Bookkeeping instances in parallel for CCRC'08. Joel agreed to prepare an updated Bookkeeping report module for DIRAC3. Zoltan commented that tests being performed between AMGA and Oracle. - Monitoring framework - Action(09) Roberto put in place the results of the ping method added to the API by Stuart. There are now SLS sensors for each service and VO-box. Andrei and Andrew reported that the availability of the DIRAC3 services was not correctly reported in the GridMap page, Roberto will investigate. ( ACTION: Roberto ) - Backup DMS services on lxgate34, port IntegrityDB to DIRAC3 - Action(27) Andrew hasn't had chance yet to perform the migration, it will be attempted this week. - Software tags and Brunel site Roberto conveyed that there were problems with the shared area at LCG.Brunel.uk and Joel agreed to investigate. ( ACTION: Joel ) 3. Production Operations Issues - Use of StoRM at CNAF Angelo took over the StoRM migration at CNAF in Marianne's absence. The last remaining step is to configure CNAF-disk in DIRAC2 and send a test job. Andrei agreed to take a look at the StoRM SE definition in DIRAC2. ( ACTION: Andrei ) - DC06 Productions Progress Philippe reported the status of the recently submitted reconstruction and stripping jobs. At PIC there was a problem observed with the dCache reporting 'cost-exceeded' when trying to open the files. Most of the remaining Tier-1s were running relatively smoothly except RAL where jobs are trying to access data in dCache and Castor at the same time. After checking the status of the DIRAC2 ProcDB Philippe asked whether there was a simple way to synchronize the ProcDB with the status of the replicas in the LFC. Andrei agreed to add this check to the addDirectory call. ( ACTION: Andrei ) A bug was found in the CheckLogFile that resulted in files inadvertently being marked at 'processed', the resolution of this should allow the creation of more jobs that can be submitted by Davide. 4. DIRAC3 Tasks Andrei suggested that there have been several developments to the GaudiApplication and JobFinalization modules that should be now tested. This also includes an update to the SoftwareDistribution module to allow local installation of missing packages. This requires testing prior to putting into production, Ricardo agreed to get in touch with Joel about the changes to the new GaudiApplication. ( ACTION: Ricardo, Joel ) 5. AOB None.

09:30 → 09:50 CCRC operations issues

- Data transfers - Staging ( GridKa ) - Data access on sites - Bookkeeping - Service and Agents CPU and memory consumption monitoring

09:50 → 10:10 Ongoing actions

(01) - 06/11/07 - Gianluca, Marianne, Joel - Remedy the Exceeded Max Staging Retry jobs and update ProcDB via development of Agents to resolve this (04) - 13/11/07 - Marianne, Andrew - RAL and CNAF migration, FTS job submissions (07) - 27/11/07 - Zoltan, Elisa, Marianne - Prototype bookkeeping system on volhcb07 (09) - 04/12/07 - Roberto, Marcos, Gianluca - Develop a general service monitoring framework leading to a virtual control room (27) - 08/01/08 - Andrew - Backup DMS services on lxgate34 to allow migration to SLC4, port IntegrityDB to DIRAC3 (50) - 01/04/08 - Joel - Investigate the software installation / availability failures of recent production jobs (55) - 08/04/08 - Marianne - Recover data that failed to be registered in the BK DB (56) - 29/04/08 - Roland, Stuart, Joel - Provide Production Manager guide (00) - 29/04/08 - DIRAC developers - DIRAC3 (ongoing)

10:10 → 10:25 Production status report

- Report from the Production meeting:

10:25 → 10:55 Production operations issues

- use of StoRM at CNAF

10:55 → 11:25 DIRAC3 tasks

- Testing new modules

11:25 → 11:35 AOB