Choose timezone
Your profile timezone:
PASTE meeting
→
Europe/Zurich
2-R-014 (CERN)
2-R-014
CERN
Description
CERN, bat 2 R-014
To join the telephone conference, click here: https://audioconf.cern.ch/call/0165202
To dial in to the conference:
a. Dial +41 22 7676000
b. Enter access code 0165202
Production and PASTE Meeting, 10th February 2009, CERN
Chair: A.Tsaregorodtsev
Minutes: S. Paterson
CERN: J.Closier, Z.Mathe, S.Paterson, M.Rashid, V.Romanovsky, A.C.Smith
Phone: R.Graciani, A.Tsaregorodtsev
Apologies: P.Charpentier, R.Santinelli, M.Sapunov
0. Ongoing Action List
(57) - 24/06/08 - Vladimir,Roberto - Automatic publishing of BDII / GOCDB information in the CS using GOCDB site names and provide a summary of recent changes
(83) - 01/09/08 - Stuart,Roberto - To perform glexec tests (pending SCAS certification)
(90) - 09/09/08 - Joel,Stuart - Use new ProductionOutputData JDL parameter in modules instead of creating LFNs
(93) - 16/09/08 - Andrew - Improve RAW data monitoring tools and status of files in online runDB
(94) - 23/09/08 - Andrew, Marcos - Using SystemLogging service for dynamic services status monitoring (Andrew to provide FTS example)
(95) - 23/09/08 - Roberto - SLS and SAM sensors development, upgrade SE tests with new DMS unit test
(96) - 23/09/08 - Roberto - Update Dashboard SAM tests visualization, GOCDB / DIRAC site name mappings
(106) - 30/09/08 - Ricardo - Produce twiki documentation for dirac-install
(109) - 14/09/08 - Matvey - Expose DataLogging interface on the web page (pending lhcbweb deployment)
(111) - 14/09/08 - Alexei,Andrei - Productions with file merging and associated data distribution implementation
(113) - 21/10/08 - Ricardo, Adri - Document the CS procedures for both the mechanism to define authorization rules in DIRAC and also the current group properties
(116) - 18/11/08 - Ricardo - Circulate a report on the recent Gauss CPU studies, steer the CPU related activities in DIRAC
(120) - 16/12/08 - Ricardo - Update TQ Director to deal with a mixture of generic / private pilots at sites (and document the submission policy)
(122) - 13/01/09 - Ricardo - Develop specialized SAM pilot director to submit, track and report errors with regard to pilots
(124) - 20/01/09 - Stuart - Apply dataset limit sanity check for user jobs (limit to 100) to client side e.g. LHCbJob
(126) - 20/01/09 - Andrei - Document the design of the workflow / production management components
(127) - 20/01/09 - Andrei,Adri - Multiple DNs in DIRAC for use-case of DN change (check job policies and web portal policies)
(129) - 27/01/09 - Ricardo - Document the job prioritization mechanism
(130) - 03/02/09 - Philippe,Andrew,Stuart - Prepare proposal for the DIRAC release procedure
(131) - 03/02/09 - Andrei, Stuart - Test BK query for production input data
Completed Actions:
Done - (117) - 18/11/08 - Ricardo - Add a site attribute to reflect whether generic pilots are accepted there, update the Director
Done - (128) - 27/01/09 - Adri - Add failover requests to the accounting clients
Done - (132) - 03/02/09 - Ricardo - Provide example of stalling Gauss jobs to Gloria
Moved to DIRAC tasks - (125) - 20/01/09 - Alexey - Production request GUI progress
1. Action Updates
- Action(57) - Automatic publishing of BDII / GOCDB information in the CS
Vladimir reported that CS information is filled via a script, this will be put into an agent as soon as possible.
- Action(83) - gLexec tests
Ongoing.
- Action(90) - Production Output Data parameter
Stuart mentioned that the new finalization mechanism is being tested in production, this splits the old job finalization
into 4 modules: SendBookkeeping; UploadOutputData; UploadLogFile and FailoverRequest. Due to the recent pilot
proxy mismatches this has not moved into production, another test will be run today.
- Action(93) - Improve RAW data monitoring tools and status of files in online runDB
Ongoing.
- Action(94) - SystemLoggingDB example
Ongoing.
- Action(95),(96) - Service Monitoring
Ongoing.
- Action(106) - Ricardo - Produce twiki documentation for dirac-install
Ongoing.
- Action(109) - Expose DataLogging interface on the web page
Ongoing.
- Action(111) - File merging productions
No progress here, the recent efforts have been on the production request GUI.
- Action(113) - CS Documentation
Ongoing.
- Action(116) - CPU studies
Ongoing.
- Action(120) - Update TQ Director to deal with a mixture of generic / private pilots at sites
Fixes for the recent problems are under test in the development system.
- Action(122) - Develop specialized SAM pilot director to submit, track and report errors with regard to pilots
Andrei wondered why the SAM pilot director thread could not be decoupled from the TQ director.
- Action(124) - Apply dataset limit check
Ongoing with low priority.
- Action(125) - Production Request GUI
See DIRAC3 tasks.
- Action(126) - Document the design of the workflow / production management components
Ongoing.
- Action(127) - Multiple DNs in DIRAC for use-case of DN change
Andrei will check whether a few fixes are pending in the JobPolicy object. Adri will check the web portal framework.
- Action(129) - Document the job prioritization mechanism
Ongoing.
- Action(130) - Prepare proposal for the DIRAC release procedure
To be discussed at the DIRAC week.
- Action(131) - Andrei, Stuart - Test BK query for production input data
Ongoing.
- Action(132) - Ricardo - Provide example of stalling Gauss jobs to Gloria
Gloria has managed to reproduce the problem from Ricardo's mail.
2. Production Status Report
- Report from the Production meeting
The dummy activity is ongoing. Urgently need to clean production monitoring page. Still pending the fix for stale NFS
file handles from core software. The most pressing operational issue is the file access at IN2P3. Andrei will follow this
up with the IN2P3 site admins. Andrew commented that the recent file upload failures from Stephane should trigger
opening of GGUS tickets. The VO view problem and shares according to the pilot role at CERN should be resolved but
if there is no progress by this afternoon this will be raised again.
- v4r7p2 release
The two major fixes here are for the Oracle backend (ancestor files) and the TQ DB. Ricardo will confirm with Adri
that everything is ok before giving a green light for deployment in production.
As a reminder the list of ongoing FEST developments is below:
- Finalize derived production mechanism
- Optimizations for the creation of jobs (for productions with input data)
- Expose production priority boosting mechanism via production API
- Introduce refined status machine to allow archiving of productions
- Introduce a ProductionGroup parameter to improve monitoring (analogous to JobGroup).
3. DIRAC Tasks
- Framework status
There were a few fixes to the portal for deployment on the gateway and it was confirmed that this seems to be
working fine now.
- Bookkeeping status
Zoltan will provide some documentation for the recently added methods (including DQ flag documentation) but there
are ongoing issues with the client external tools. Zoltan will get in touch with Matvey in order to help with the BK web
GUI development. The BK views are now being rebuilt every 30minutes.
- WMS status
Discussed above in the actions. Andrei will send a link to Stuart about the MonaLisa tools to gather information from
the host machines.
- DMS status
The interface of the SE has changed to support using request tokens and is under test. Andrew will now go through
the code to check where the SE is used directly before proceeding. The proxy SE is also in place, this allows users to
interact with Grid storage via a DISET proxy. This is currently throttled by a certain number of threads per method.
Andrew will investigate the feasibility of providing an AFS getFile method.
- Production Management status
Alexey has developed an impressive production request page and this should be integrated with the lhcbtest page.
For the MC this is almost complete but data processing productions will require a BK query widget for the input data.
The utilities for populating the BK processing passes / simulation conditions are very useful independently of the
production request machinery so it will be checked whether they can easily be provided separately. How the
information from Production and BK can be provided in a unified way will be discussed at the DIRAC week.
4. AOB
The tentative schedule for the DIRAC week was added to the agenda, Andrei will circulate a mail to confirm this.
Meeting closed at 10:56.
There are minutes attached to this event.
Show them.