Choose timezone
Your profile timezone:
PASTE meeting
→
Europe/Zurich
2-R-014 (CERN)
2-R-014
CERN
Description
CERN, bat 2 R-014
To join the telephone conference, click here: https://audioconf.cern.ch/call/0165202
To dial in to the conference:
a. Dial +41 22 7676000
b. Enter access code 0165202
Production and PASTE Meeting, 31st March 2009, CERN
Chair: A.Tsaregorodtsev
Minutes: S. Paterson
CERN: P.Charpentier, J.Closier, Z.Mathe, S.Paterson, M.Rashid, R.Santinelli, A.C.Smith, F.Stagni
Phone: A.Tsaregorodtsev, R.Graciani
Apologies: M.Sapunov
0. Ongoing Action List
(94) - 23/09/08 - Andrew, Marcos - Using SystemLogging service for dynamic services status monitoring (Andrew to provide FTS example)
(95) - 23/09/08 - Roberto - SLS and SAM sensors development, upgrade SE tests with new DMS unit test
(96) - 23/09/08 - Roberto - Update Dashboard SAM tests visualization, GOCDB / DIRAC site name mappings
(109) - 14/09/08 - Matvey - Expose DataLogging interface on the web page (pending lhcbweb deployment)
(111) - 14/09/08 - Alexei,Andrei - Productions with file merging and associated data distribution implementation
(116) - 18/11/08 - Ricardo - Circulate a report on the recent Gauss CPU studies, steer the CPU related activities in DIRAC
(122) - 13/01/09 - Ricardo,Vladimir - Develop specialized SAM Agent to track and report errors with regard to pilots
(124) - 20/01/09 - Stuart - Apply dataset limit sanity check for user jobs (limit to 100) to client side and protect data operations
(126) - 20/01/09 - Andrei - Document the design of the workflow / production management components
(132) - 03/03/09 - Stuart - Update LFN construction utility to store production output directories as a parameter
(133) - 03/03/09 - Matvey - Provide request DB interface page
(134) - 03/03/09 - Matvey,Andrew - Provide RunDB monitoring page
(135) - 03/03/09 - Andrew - Send accounting from Online DIRAC instance via the gateway to PIC
(136) - 03/03/09 - Vladimir,Roberto,Joel - Integration of existing SAM infrastructure tests into DIRAC SAM framework
(137) - 10/03/09 - Ricardo - Implementing banning specific job types
(138) - 10/03/09 - Andrei - Make a proposal for coping with problematic Tier1 sites absent for long periods during data taking
(139) - 31/04/09 - Roberto,Stuart - Track and test glexec as it is deployed at the sites, put CE into production pending the official release
(140) - 31/04/09 - Ricardo - Formulation of procedure for how to treat banning of sites based on job requirements e.g. input data / staging...
Completed Actions:
Done - (57) - 24/06/08 - Vladimir,Roberto - Automatic publishing of BDII / GOCDB information in the CS using GOCDB site names and provide a summary of recent changes
Done - (83) - 01/09/08 - Stuart,Roberto - To perform glexec tests (pending SCAS certification)
Done - (90) - 09/09/08 - Joel,Stuart - Use new ProductionOutputData JDL parameter in modules instead of creating LFNs
1. Action Updates
- Action(94) - SystemLoggingDB example
Andrew has heard nothing from Marcos regarding this action.
- Action(95),(96) - Service Monitoring
The SE test was extended to run against all space token and negative tests were removed from the suite. Roberto
conveyed that these improvements should make things clearer for site admins. The dashboard updates are also
ongoing.
- Action(109) - Expose DataLogging interface on the web page
Ongoing. This is not yet deployed in production.
- Action(111) - File merging productions
No progress here, the recent efforts have been on the production request GUI.
- Action(116) - CPU studies
Ongoing. It was suggested to reintroduce Roberto's benchmarking utility in Development before the more detailed
results and corresponding utility is available from Ricardo.
- Action(122) - Develop specialized SAM Agent to track and report errors with regard to pilots
Ongoing.
- Action(124) - Apply dataset limit check
Ongoing with low priority, Stuart will try to do this before leaving on vacations.
- Action(126) - Document the design of the workflow / production management components
Ongoing.
- Action(133) - RequestDB monitoring
Andrew will look at the prototype in lhcbtest when available and send comments to Matvey.
- Action(134) - Provide RunDB monitoring page
An update of the DIRAC installation at the online will be scheduled with Niko for next week.
- Action(135) - Send accounting from Online DIRAC instance via the gateway to PIC
Ongoing.
- Action(136) - Integrate SAM infrastructure tests
Ongoing.
- Action(137) - Implementing banning specific job types
The job types are now part of the job matching mechanism, there was some discussion on how to proceed with
banning job types for sites.
- Action(138) - Proposal for coping with problematic Tier1 sites absent for long periods during data taking
After some discussion two use-cases emerged, firstly the option to recreate a job changing the destination site and
secondly the chance to run a job at a different site and retain the original destination for the outputs. Andrei agreed
to update the page after these discussions.
2. Production Status Report
- Report from the Production meeting
Restarting the dummy is pending the next DIRAC release and the deployment of the updated install_project. It was
agreed to restart the dummy production on Thursday. Andrei raised the issue of the recent request from Heidelberg,
the consensus around the table was that DC06 is over (as announced last November to the OPG and PPG).
- v4r10p2 release
Andrew commented that the recent fixes for the LFC session management are in place and fully tested. Andrei will
prepare a p2 release for this.
3. DIRAC Tasks
- Bookkeeping status
Zoltan has implemented different views based on file types and making it easy to retrieve input data catalogs for
selections. A production based BK view is also under preparation. The number of connections to the Oracle DB is
currently set at 20, Zoltan will try to get this increased.
- DMS status
Andrew developed an LFC admin interface to carry out procedures for new users when entered into VOMS e.g. adding
the home directory with the correct permissions. The dataset code is being refurbished and tested with Greig. The
SRM2 storage interface was updated to prevent users from writing into directories with permissions that do not
support it.
- Production Management status
The production request page has been updated and feedback would be welcome.
- Web Portal
Streamlined monitoring views are becoming urgent. There was some discussion on how to proceed with GraphTool,
the first iteration could reproduce DIRAC2 plots and would not have to overcome the limitations of GraphTool.
- VO-boxes
A proposal for the necessary hardware for our central services will be prepared by Ricardo and Adri. Joel commented
that the recent machine request is still pending.
- Documentation
The project web pages must provide enough documentation for others to understand the system. Andrei circulated a
twiki link for people to contribute. There was some discussion regarding 'trac', the updated twiki available with
subversion.
4. AOB
None
There are minutes attached to this event.
Show them.