PASTE meeting

Tuesday 19 May 2009, 09:30 → 13:15 Europe/Zurich

2-R-014 (CERN)

Andrei Tsaregorodtsev

CERN, bat 2 R-014 To join the telephone conference, click here: https://audioconf.cern.ch/call/0165202 To dial in to the conference: a. Dial +41 22 7676000 b. Enter access code 0165202

Review of actions: 116 - Ricardo: Looked into HEP spec database although contains lots of information. 139 - Ricardo: Far from production, fail to pass the environment from pilot shell to pay load processes. Roberto: Savanah bug to be filed requesting correct handling of environment. also other configuration issues discovered. Ricardo: We should only be testing a production system. Philippe: Wait until Stuart is back. We are not requiring gLexec and we continue to use generic pilots regardless. 144 - Zoltan: Added start date and end date from the query allowing you to select files (closed) 145 - Vladimir: SAM jobs run under lhcb_prod role. Checking the mapping can only be done by checking the permissions on the shared area. New test to be created (Roberto). 146 - Second point (Should be complemented with the installed SW monitoring tools) should become a new action on Joel, Vladimir. 147 - volhcb13 - now installed with SLC4 with 2 disks. Ricardo to begin playing. volhcb?? - new configuration as discussed with B. Panzer. 7 file systems 1TB has been requested 149 - Closed after successful testing Production operations: No production operations yesterday. Last week and over the weekend MC09 sample produced discovered to have B lifetime of 0. New applications being prepared to resolve this. All FEST FULL stream jobs failed while the express stream runs as expected (being investigated). A request was made for the shifters to follow more closely the user activities. DIRAC Tasks Infrastructure Monitoring - Joel: Summary of discussions of SAM to be circulated. Merging infrastructure tests with SAM. Roberto: Site naming in the dashboard to be programmable (currently hard coded). SLS monitoring of host ping results linked to lemon. Ricardo: LFC mirrors being tested? Roberto: Yes, multiple tests, lfc-lr test and streaming tests. Bookkeeping: Zoltan: New updates not released, will check whether the client or service requires a release. WMS Status: Ricardo: Update to the priorities based on the group. Web portal: Ricardo: System overview page being worked on (Matvey). Documentation: Zoltan now writing documentation for the BK. AOB: Ricardo: Should be able to limit the number of jobs running per site. Matcher should be provided a list of sites which it can match and the number of jobs. Federico will produce proposal during DIRAC week. Ricardo: Should we provide site ranking metrics based on SAM success for LHCb? To be discussed during a mini-workshop to be arranged during DIRAC week (8th of June)

09:50 → 10:10 Ongoing actions

(94) - 23/09/08 - Andrew, Marcos - Using SystemLogging service for dynamic services status monitoring (Andrew to provide FTS example) (111) - 14/09/08 - Alexei,Andrei - Productions with file merging and associated data distribution implementation (116) - 18/11/08 - Ricardo - steer the CPU related activities in DIRAC, document procedures, move to the HEP CPU units (122) - 13/01/09 - Ricardo,Vladimir - Develop specialized SAM Agent to track and report errors with regard to pilots (132) - 03/03/09 - Stuart - Update LFN construction utility to store production output directories as a parameter (133) - 03/03/09 - Matvey - Provide request DB interface page (139) - 31/03/09 - Roberto,Stuart,Ricardo - Track and test glexec as it is deployed at the sites, put CE into production pending the official release (140) - 31/03/09 - Andrew - Formulation of procedure for how to treat banning of sites based on job requirements e.g. input data / staging... (143) - 14/04/09 - Andrei - update the links in the job monitoring info sent to SiteMonitoring (144) - 21/04/09 - Zoltan - propose and implement solutions to reduce the Bookkeeping service load for production input data queries (145) - 21/04/09 - Vladimir,Roberto,Joel - check why SAM application test jobs are running by sgm user on some sites (146) - 21/04/09 - Vladimir,Joel - SAM SW installation logic by synchronizing shared areas with the CS SW specification. Should be complemented with the installed SW monitoring tools. (147) - 21/04/09 - Joel - renew the request to IT for deployment of the new LHCb/DIRAC central host machine (148) - 21/04/09 - Joel - setup DIRAC SVN/Trac project portal and configure access to the DIRAC developer team. (149) - 05/05/09 - Ricardo,Andrew - test the --use-grid SetupProject option to set the LFC_HOST to be used by CORAL with Merging jobs

10:10 → 10:25 Production issues

- Report from the Production meeting

10:25 → 10:55 DIRAC tasks

- Infrastructure monitoring (SAM,SLS,Dashboard) - Framework status - Bookkeeping status - WMS status - DMS status - Production Management status - VO-boxes - Web Portal - Services deployment ( hardware, configuration ) - Documentation

10:55 → 11:05 AOB

Discussion on the integration of SAM utilities Today we (Joel, Roberto, Vladimir) can consider that we have the SAM suite for LHCb split in three part : Software installation, LHCb tests (run by Vladimir) and WLCG tests (run by Roberto). Software Installation : This part is run by hand today. Vladimir will create an agent that will run it at least once per day to start with. In the CS a Software manager section will be created (identical to the one for SAM manager). This software manager will have the role=lcgadmin. In the near future this part will evolve in order to publish the content of each shared area (action Joel) LHCb tests (SAM suite) : These tests are running as an agent on volhcb09 with the role=production every 6 hours. No change are forseen for the time being, except the integration of the next section. WLCG tests: These test will be integrated in the previous section as much as possible. These tests are composed of several parts : CE, SRM, LFC, FTS, gRB and myproxy 1 - the code will be put in CVS (under LHCbSystem/Testing/SAM/roberto) 2 - integration one by one of these test in the LHCb tests. All the results are published to the SAM DB and visible through the dashboard. We will study to migrate the results from SAMDB to NAGIOS starting in september..