Choose timezone
Your profile timezone:
PASTE meeting
Description
CERN, bat 2 R-030
To join the telephone conference, click here: https://audioconf.cern.ch/call/0165202
To dial in to the conference:
a. Dial +41 22 7676000
b. Enter access code 0165202
Production and PASTE Meeting, 26th August 2008, CERN
Chair: A.Tsaregorodtsev
Minutes: S. Paterson
CERN: P.Charpentier, J.Closier, Z.Mathe, S.Paterson, V.Romanovsky, R.Santinelli
Phone: R.Bernet, N.Brook, R.Nandakumar, A.Tsaregorodtsev
Apologies: A.C.Smith
0. Ongoing Action List
(07) - 27/11/07 - Zoltan, Elisa - Prototype bookkeeping system, roadmap for production
(09) - 04/12/07 - Roberto, Marcos - Develop a general service monitoring framework leading to a virtual control room
(57) - 24/06/08 - Vladimir - Automatic publishing of BDII information in the CS using GOCDB site names
(63) - 22/07/08 - Roberto,Joel - Develop DIRAC3 script for adding new users to the VO + CS + LFC registration
(65) - 05/08/08 - Roberto - Define our SAM tests in the dashboard
(70) - 12/08/08 - Joel - DIRAC3 installation in the LHCb release area at CERN
(71) - 19/08/08 - Andrei,Joel - Add comment field to mask operations and formulate procedure
(72) - 19/08/08 - Roberto,Vladimir - Check BDII / GOCDB inconsistencies in site published informations
(73) - 19/08/08 - Andrei - Resolve BK catalogue status problems in the Replica Manager
(76) - 26/08/08 - Hubert - Modifications to install_project to support SGM pool accounts
(77) - 26/08/08 - Philippe - Prepare summary of SGM pool account saga for MB
(78) - 26/08/08 - Zoltan - Update BK twiki page with current machines, services & setups
(79) - 26/08/08 - Andrei, Vladimir - Update CS to use new host aliases
(80) - 26/08/08 - Stuart - Update DIRAC2 Stager for SRMv1->v2 migration
(81) - 26/08/08 - Roberto - Obtain interactive analysis on a PPS WN for glexec testing
Completed Actions:
Done - (62) - 22/07/08 - Roberto - Check whether glite 3.1 comes with requested features/patches & coordinate upgrades
Done - (68) - 05/08/08 - Zoltan - Migrate new BK from volhcb07 -> volhcb04
Done - (69) - 12/08/08 - Joel - All the sites to provide single user account for the sgm user
Done - (74) - 19/08/08 - Joel - Create list of host aliases attached to the agenda of last week
Done - (75) - 19/08/08 - Stuart,Vladimir - Make command line tools for managing LHCb Software
1. Action Updates
- Action(07) - Prototype Bookkeeping
Zoltan is working on the GUI for the Bookkeeping and has made several updates to the Oracle DB schema. The
migration of one existing production took 45mins so this is a long production. The production BK services are now on
volhcb05 and volhcb07 has been freed. The timescale for developing the necessary interfaces and checking the
contents is by the end of the week. Discussions regarding the simulation conditions are ongoing, these should be
available in the BK such that users can query for a summary. These configurations will then be entered in the
workflows by name. It was suggested to prepare a roadmap for the migration to the new Bookkeeping. Since current
jobs are reporting the replica flags to the new BK only then this should also be conveyed to the old BK. After some
discussion it was agreed to restore the population of the old BK replica flag in the DMS components.
- Action(09) and Action(65) - Virtual Control Room
There was some discussion regarding monitoring of Agents. If CPU / Memory is not reported by agents then it could
be considered as a heartbeat mechanism for an SLS sensor. The SAM SRM test results are being summarized weekly
in order to support the site availability, there was some discussion on whether this should be extended to the CE
tests. The Dashboard graphical interface prototype is being prepared for LHCb and Vladimir was asked to support
meaningful DIRAC site names. The calculation of site reliability based on daily activities in the logging system is the
next step.
- Action(57) - Automatic publishing of BDII information in the CS
Some scripts are being prepared to check BDII <-> CS information, this is ongoing.
- Action(62) - Check whether glite 3.1 comes with requested features/patches & coordinate upgrades
Roberto summarized his ELOG report.
- Action(63) - DIRAC3 scripts for adding new users to the VO + CS + LFC registration
Tests are ongoing as new users appear but the tool is in place, script should be added to CVS.
- Action(69) - Single user account for SGM user
After discussion at the MB level there are some security concerns with static accounts so it was agreed to continue to
put protection in place on our side (install_project) for the pool accounts. ( ACTION: Hubert ) Philippe will prepare a
summary of the difficulties for the MB ( ACTION: Philippe ).
- Action(70) - DIRAC3 installation in the LHCb release area at CERN
Joel has prepared a DIRACEnv type script to set the environment. Reminder: last week it was agreed to enable write
permission to the DIRAC configuration file for the DIRAC developers in case of emergencies.
- Action(72) - GOCDB / BDII Inconsistencies
Vladimir conveyed that the available information is inconsistent for some sites and is working with Roberto to ensure
this is resolved. The CEs list is being updated.
- Action(73) - BK catalogue status problem in Replica Manager
Andrei will summarize the JobFinalization modifications and document the policies for output data policy.
2. Production Issues
- Report from the Production meeting
Stuart mentioned that the DC06 productions were on hold until the but these were ramped up yesterday after the
changes from Andrei. The highest priority is to stabilize the stripping (lumi5) and processing of two recent DC06
productions. The simulation condition discussed above is required for the 2008 Alignment productions (as well as the
new Gauss release). Testing with real data from the Online is also being pursued. Updates to the job final status
'Completed' -> 'Done would be greatly appreciated for the shifters to understand failover operations.
- v0r4p4 release
Andrei compiled the release notes for the latest patch release in CVS and added a report to the ELOG.
- Bookkeeping service availability
Andrei conveyed that there has been a problem with the BK service ports on volhcb01 (9201,9202), Joel agreed to
investigate. ( ACTION: Joel ) Zoltan was asked to update the BK twiki page with the list of machines, services, setups
and ports currently in use. ( ACTION: Zoltan )
- SRM v1-> v2 migration
Andrei updated the CS for the migration as outlined by the plan. Stuart conveyed that modifications to the Stager are
not yet done and asked what the timescale for this is. Philippe commented that the migration of the catalogue must
be completed before the deadlines suggested by the sites. It was agreed to concentrate on the DIRAC3 stripping
before performing the DIRAC2 stager modifications.
Roberto summarized his ELOG entry regarding WLCG operations and mentioned that the alarm ticket mechanism
(asked to check this in Production Operations) was ok.
3. DIRAC3 Tasks
- Request Management
Improved monitoring of requests progress will be put in place when Matvey returns.
Update status of the jobs after pending requests are completed
- glexec Tests
Roberto was asked to obtain interactive access to a PPS WN to expedite our testing. ( ACTION: Roberto )
- Instrumentation of the pilot to report batch system parameters
There was some discussion to instrument to the pilot to report finer grained information to the batch systems. Andrei
suggested Ricardo could add this at the end of the pilot script initially.
4. AOB
Philippe mentioned that there will be a pre-GDB meeting dedicated to storage concerns in September.
There are minutes attached to this event.
Show them.