Choose timezone
Your profile timezone:
PASTE meeting
→
Europe/Zurich
2-R-014 (CERN)
2-R-014
CERN
Description
CERN, bat 2 R-014
To join the telephone conference, click here: https://audioconf.cern.ch/call/0165202
To dial in to the conference:
a. Dial +41 22 7676000
b. Enter access code 0165202
Production and PASTE Meeting, 14th April 2009, CERN
Chair: A.Tsaregorodtsev
Minutes: A.Tsaregorodtsev
CERN: Z.Mathe,R.Santinelli,F.Stagni,A.Zhelezov,M.Adinolfi
Phone: V.Romanovsky, A.C.Smith, R.Graciani, M.Sapunov, A.Tsaregorodtsev
0. Ongoing Action List
(94) - 23/09/08 - Andrew, Marcos - Using SystemLogging service for dynamic services status monitoring (Andrew to provide FTS example)
(95) - 23/09/08 - Roberto - SLS and SAM sensors development, upgrade SE tests with new DMS unit test
(96) - 23/09/08 - Roberto - Update Dashboard SAM tests visualization, GOCDB / DIRAC site name mappings
(109) - 14/09/08 - Matvey - Expose DataLogging interface on the web page (pending lhcbweb deployment)
(111) - 14/09/08 - Alexei,Andrei - Productions with file merging and associated data distribution implementation
(116) - 18/11/08 - Ricardo - Circulate a report on the recent Gauss CPU studies, steer the CPU related activities in DIRAC
(122) - 13/01/09 - Ricardo,Vladimir - Develop specialized SAM Agent to track and report errors with regard to pilots
(124) - 20/01/09 - Stuart - Apply dataset limit sanity check for user jobs (limit to 100) to client side and protect data operations
(126) - 20/01/09 - Andrei - Document the design of the workflow / production management components
(132) - 03/03/09 - Stuart - Update LFN construction utility to store production output directories as a parameter
(133) - 03/03/09 - Matvey - Provide request DB interface page
(134) - 03/03/09 - Matvey,Andrew - Provide RunDB monitoring page
(136) - 03/03/09 - Vladimir,Roberto,Joel - Integration of existing SAM infrastructure tests into DIRAC SAM framework
(139) - 31/03/09 - Roberto,Stuart - Track and test glexec as it is deployed at the sites, put CE into production pending the official release
(140) - 31/03/09 - Andrew - Formulation of procedure for how to treat banning of sites based on job requirements e.g. input data / staging...
(141) - 07/04/09 - Vladimir,Roberto - Investigate reason for downtime calendar not being updated
(142) - 14/04/209 - Adri - verify that the data transfer monitoring info sent to SiteMonitoring is functioning
(143) - 14/04/209 - Andrei - update the links in the job monitoring info sent to SiteMonitoring
1. Action Updates
- Action(94) -
Ongoing.
- Action(95) -
Problems with the LFC unit test failure due to a failing LFC mirror are fixed. SRM unit tests is still
being polished.
- Action(96) -
LHCb data transfers monitoring info is not properly published (Action Adri). Links for the Job Monitoring info
should be fixed (Action Andrei)
- Action(109) -
Ongoing.
- Action(111) -
The action is postponed until the MC'09 production with file merging will be sorted out manually.
- Action(116) - CPU studies
Ongoing.
- Action(122) - Develop specialized SAM Agent to track and report errors with regard to pilots
Ongoing.
- Action(124) - Apply dataset limit check
Ongoing with low priority.
- Action(126) - Document the design of the workflow / production management components
Ongoing. Will be updated once the MC'09 procedures are all sorted out
- Action(132) -
Ongoing with lower priority
- Action(133) - RequestDB monitoring
Single request monitoring is available. Summary page is ongoing
- Action(134) - Provide RunDB monitoring page
RunDB monitoring is available now. Monitoring the data files is in the works.
- Action(136)
Ongoing.
- Action(139) -
The tests of the glexec functionality are done. Tests will have to be repeated for all the new sites
deploying glexec in various modes.
- Action(140) - Banning faulty storage elements
The TWiKi page with the initial proposal has been circulated. Ongoing.
- Action(141) -
The mails with the Downtime notifications restarted to be sent. The mail parsing should be updated
because of recent modifications.
2. Production Status Report
- Production status
The only ongoing production is dummy, will be extended by 10K jobs. The dummy production
will be recreated later this week to execute on all teh T1's with 0 priority.
Andrew is preparing the FEST production. It is being tested now offline. Waiting for the online
to restart the FEST production later this week. Pending:
- release of he new versions of Brunal and DaVinci applications;
- Sending proper bookkeeping info from the online database.
- MC'09
For the MC generation
Things remaining to do:
- Wait for the release of the applications next (two) week.
- Ensure the BK entry produced by the MC generation is invisible to users (nothing to do here)
For the MC merging
Things remaining to do:
- The new version of install_project which should be tested by Vladimir as soon as possible.
The tests show problems with the latest version with some errors that do not seem fatal.
Vladimir will check with Hubert
- Ensure the BK entry produced by the MC generation is visible to production system.
- Commission the merging workflow.
The tests were performed by Stuart and are successful
- Determine the policy for removing the small DSTs after merging.
The policy is to do the removal right in the merging job, reverting to the failover
mechanism if necessary. The corresponding workflow module is prepared.
- Data distribution policy to be configured for replication of the merged DSTs.
Andrew is preparing that. The machinery is available but should be properly
configured.
- Update the BK report module to correctly report missing parameters.
Andrew is checking together with Zoltan.
- v4r11 release
Compiled and istalled in production systems and pilots. Zoltan has already few fixes
to the BK client, this needs a new patch release.
- Web Portal
Ricardo will negociate with the PIC managers the ways to increase the Web Portal availability
even during scheduled site shutdowns. He will also check the possibility to use OPN network
connection to reduce the portal round-trip time.
3. DIRAC Tasks
- Framework status
Security logs now can be sent to the local syslog. This is the case requested at GridKa. Needs
update of the GridKa VO-box configuration
- Bookkeeping status
Few bug fixes to go into the new release.
- WMS status
TaskQueueDirector updated to work with distinct WMS instances to allow better error traceability.
pilot ubmission errors are now sent to the lhcb-devel mailing list. Ricardo will set up a new
agent to analyse this kind of errors in the Logging database and send out only error summaries.
Eventually, the errors will be reported to the SAM DB.
- Production Management status
Being testsed in the Dev system. Needs fixes to send notifications through the Notification service.
- VO-boxes
No update.
- Web Portal
RunDB monitoring page is now available.
- Services deployment ( hardware, configuration )
No response from the hardware request made over a month ago.
4. AOB
There are minutes attached to this event.
Show them.