Choose timezone
Your profile timezone:
PASTE meeting
→
Europe/Zurich
2-R-014 (CERN)
2-R-014
CERN
Description
CERN, bat 2 R-014
To join the telephone conference, click here: https://audioconf.cern.ch/call/0165202
To dial in to the conference:
a. Dial +41 22 7676000
b. Enter access code 0165202
Production and PASTE Meeting, 2nd June 2009, CERN
Chair: A.Tsaregorodtsev
Minutes: S. Paterson
CERN: M.Adinolfi, P.Charpentier, J.Closier, Z.Mathe, S.Paterson, V.Romanovsky, R.Santinelli, A.C.Smith, F.Stagni
Phone: R.Graciani, A.Tsaregorodtsev
Apologies: M.Sapunov
0. Ongoing Action List
(94) - 23/09/08 - Andrew, Marcos - Using SystemLogging service for dynamic services status monitoring (Andrew to provide FTS example)
(111) - 14/09/08 - Alexei,Andrei - Productions with file merging and associated data distribution implementation
(116) - 18/11/08 - Ricardo - steer the CPU related activities in DIRAC, document procedures, move to the HEP CPU units
(122) - 13/01/09 - Ricardo,Vladimir - Develop specialized SAM Agent to track and report errors with regard to pilots
(133) - 03/03/09 - Matvey - Provide request DB interface page
(139) - 31/03/09 - Roberto,Stuart - Track and test glexec as it is deployed at the sites, put CE into production pending the official release
(140) - 31/03/09 - Andrew - Formulation of procedure for how to treat banning of sites based on job requirements e.g. input data / staging...
(143) - 14/04/09 - Andrei - Update the links in the job monitoring info sent to SiteMonitoring
(146) - 21/04/09 - Vladimir,Joel - SAM SW installation logic by synchronizing shared areas with the CS SW specification. Should be complemented with the installed SW monitoring tools.
(148) - 21/04/09 - Joel - Setup DIRAC SVN/Trac project portal and configure access to the DIRAC developer team.
(151) - 26/05/09 - Andrew,Andrei - Update central components with optimized BK methods
(152) - 26/05/09 - Stuart - Investigate the crashes when using the copy local option for SQL DDDB files
(153) - 26/05/09 - Ricardo,Joel - Investigate optimal hardware configurations for DIRAC servers
(154) - 02/06/09 - Stuart - Define production parameter set to be persisted outside of workflow object
(155) - 02/06/09 - Roberto,Stuart - Open bug against gLExec for environment issue
(156) - 02/06/09 - Ricardo,Joel - Refine VO-box setup to minimize impact of updates and maintenance procedures
Completed Actions:
Done - (145) - 21/04/09 - Vladimir,Roberto,Joel - Create SAM sensor to ensure production role is not mapped to sgm at sites
Done - (150) - 26/05/09 - Ricardo,Roberto - Prepare summary in response to Steve Traylen's request
1. Action Updates
- Action(94) - SystemLoggingDB example
Ongoing, will be discussed during the DIRAC week in June.
- Action(111) - File merging productions
Alexei should make use of the production API. Joel commented that the production request testing resulted in a few
bug fixes from Alexey. The last part is to define the evolution of the technical evaluation to the production creation.
- Action(116) - CPU studies
Roberto circulated a proposal from Steve Traylen, a summary of the LHCb requirements will be prepared by Ricardo
and Roberto. Ricardo has updated the new specint database with the results from his tests, ongoing.
- Action(122) - Develop specialized SAM Agent to track and report errors with regard to pilots
Ongoing.
- Action(132) - Update LFN construction utility to store prod output directories as a parameter
Reformulated to more general point of defining the production parameters that should be persisted outside of the
workflow object.
- Action(133) - RequestDB monitoring
Not yet ready after comments from Andrew.
- Action(139) - gLexec testing after deployment at new sites
Philippe summarized the summary of recent mails regarding gLExec and the environment issues. Since gLExec can
destroy the environment we may have to cache the environment ourselves. Stuart mentioned that we were asked to
open a bug for this issue against gLExec. ( ACTION: Roberto,Stuart )
- Action(140) - Banning faulty storage elements
Ongoing, Andrew agreed to prepare the proposal for next week.
- Action(143) - Update links in the job monitoring info
Ongoing. Philippe suggested a mini-workshop for monitoring in the future, Andrei suggested a meeting with Julia and
Pablo sometime during the DIRAC week.
- Action(145) - Sensor for SAM production vs. sgm mappings at sites
Procedure is understood, action can be closed.
- Action(146) - SAM software distribution synchronization with the CS
Joel started to look at this, the cleaning of the shared area orphan packages was implemented.
- Action(148) - Setup DIRAC SVN/Trac project portal and configure access to the DIRAC developer team
Progress on this will be presented at the next DIRAC week. Whether or not Trac is useful should be understood and
Joel will circulate a mail with the SVN/Trac details.
- Action(150) - Summary regarding CPU time left request
Roberto conveyed this to Steve, action.
- Action(151) - Update of central BK components with optimized methods
Ongoing.
- Action(152) - Investigate crashes for local DB copying
Ongoing.
- Action(153) - Investigate optimal hardware configurations for DIRAC servers
To be discussed next week.
2. Production Status Report
- Report from the Production meeting
Pending productions for MC09 ran over the weekend. NFS SQL DDDB locking problem should hopefully disappear
pending action (152). IN2P3 "bad credential" problems resulted in discussion on banning SEs for a long time. After
the meeting Stuart will circulate the production results for examination by Ulrik and Patrick.
- FEST'09 / STEP'09
Philippe circulated a proposal for STEP'09, see mailing lists. Data is being transferred to the Tier-1 sites now. Other
things to test include:
o Local SQLite DB copies
o IN2P3 / NIKHEF RAW file access
o Cleaning the caches at the Tier-1 sites for reprocessing.
- v4r14p5
Andrei made a patch release to fix issues with dCache file access and SAM job submission.
- volhcb13
Tests should be performed using the different partitions and splitting of mysql. Local user accounts (mysql and dirac)
should be present and not removable. Procedures for the maintenance of the volhcbYY machines should be clarified
e.g. how kernel updates / standard configurations affect our VO boxes. ( ACTION: Ricardo, Joel )
3. DIRAC Tasks
Components without updates or discussed above are omitted.
- Infrastructure monitoring (SAM,SLS,Dashboard)
Roberto mentioned that the change to Nagios implies a change of client to publish results. Tests have been performed
with publishing site information from the CS to convey VO specific settings. The DMS unit test found a regression bug
with GFAL affecting the way errors were conveyed.
- Framework status
Andrei added the first version of an updated graphing package allowing consistent treatment of colours / line graphs
etc. In addition a plotting service is available in the framework allowing to serve plots.
- WMS status
Stuart mentioned that the unannounced introduction of dCache environment variables caused a loss of time last
week. Greig has conveyed the issue to the developers.
4. AOB
None
There are minutes attached to this event.
Show them.