SRM2.2 deployment workshop

13 Nov 2007, 09:00 → 14 Nov 2007, 17:30 Europe/Zurich

Cramond, Newhaven (National eScience Centre)

Flavia Donno (CERN), Greig Cowan (University of Edinburgh, GridPP)

When the Large Hadron Collider (LHC) experiments at CERN begin to operate in 2008, they will generate petabytes of data per year. In order to store and process all of the information, an international data and computing grid is being constructed, coordinated by the Worldwide LHC Computing Grid (WLCG) project. The ability to store the generated data is central to the success of the project. Part of the solution is SRM2.2, a storage management protocol which has been implemented by multiple software providers. The software provides a uniform interface for accessing storage in a distributed Grid environment. The two most widely deployed systems in production are dCache and DPM. In addition, some Grid sites have deployed the CASTOR system while others have recently been evaluating StoRM. The goal of the workshop is to bring Grid site administrators with experience of dCache, DPM and StoRM together with software developers and other Grid storage experts. This will present a forum for information exchange regarding the deployment and operation of SRM2.2 services. By the end of the workshop, site administrators will be fully aware of the technology that must be deployed by February 2008 in order to provide a service that fully meets the needs of the LHC physics programme. Particular attention will be paid to the large number of sites who contribute small amounts of computing and storage resource (Tier-2s), as compared with national laboratories (Tier-1s). Configuration of SRM2.2 spaces and storage information publishing will be the main topics of interest during the workshop. Organisation This event is organised by GridPP, NeSC and WLCG-GSSD. Registration Please note this event is by invitation only. If you have received an invitation and intend to attend please register using the link below. If you have not received an invitation and feel you should have please contact Greig Cowan. http://www.nesc.ac.uk/esi/events/827/ Information Regular postings about the event are made to the GridPP storage blog: http://gridpp-storage.blogspot.com/search?q=workshop Map of Edinburgh and workshop location: http://maps.google.co.uk/maps/ms?ie=UTF8&msa=0&om=1&msid=103528710735499584531.00043e8870078c27bb456&ll=55.943638,-3.180977&spn=7.941742,23.466797&z=6

Tuesday 13 November

StoRM (main workshop starts at 1pm)

This has been organised to accommodate Tier-2s who are interested in StoRM but who also want to attend the DPM and dCache sessions on Wednesday. The main workshop starts at 1pm on Tuesday. Unless you have registered for the StoRM session or are a dCache Tier-1 you should aim to arrive at NeSC for the start of the main workshop.

During this session the StoRM project will be presented in details and internals, there will be an installation and configuration tutorial to describe how a site can set up StoRM and a practical hands on session where users can see StoRM at works together with developers.

1 What is StoRM and How it works

Introduction to the StoRM project and internals features

Slides Understanding_StoRM.pdf.pdf

2 Installation and configuration

document namespace.xml storm.properties

Slides Installation_and_configuration.pdf namespace.pdf

3 Coffe break

4 Hands on session

Slides Handson.pdf

dCache Tier-1s (main workshop for everyone else starts at 1pm)

Dedicated session for the Tier-1s.

5 Tier-1 update

10:30 break

6 Lessons learned

Workshop welcome

Welcome everyone to Edinburgh and NeSC. Quick overview of the material to be covered. This is the official start of the workshop.

7 Introduction

Speaker: Dr Greig Cowan (University of Edinburgh)

Slides cowan_introduction.pdf

SRM2.2 concepts

Covers the basic concepts of spaces, reservations, tokens as applies to storage at Tier-1s and Tier-2s (i.e. disk). This ideas presented here will be used throughout the workshop.

8 WLCG and SRM: some background

A presentation covering the reasons behind the development of the SRM interface and how it will be used within the WLCG project.

Speaker: Dr Flavia Donno (CERN)

Slides SRM2-history.pdf SRM2-history.ppt

9 Spaces, tokens and descriptions: the language of SRM2.2

Speaker: Maarten Litmaath (CERN)

Slides ML071113.pdf ML071113.ppt

10 SRM2.2 in DPM

Speaker: Jean-Philippe Baud (CERN)

Slides SRM2.2_deployment_workshop.pdf SRM2.2_deployment_workshop.ppt

11 SRM2.2 in dCache

Speaker: Timur Perelmutov (FERMI NATIONAL ACCELERATOR LABORATORY)

Slides dCache.SRM.15.minutes.presentation.pdf

12 SRM2.2 in CASTOR

Speaker: Jens Jensen (CLRC-RAL)

Slides CASTOR-SRM_Status.pdf CASTOR-SRM_Status.ppt

13 SRM2.2 in StoRM

Speaker: Dr Riccardo Zappi (CNAF-INFN)

Slides srmconcepts.pdf

14 SRM2.2 and GLUE1.3

Description of how the information system will be used to publish SRM2.2 details.

Speaker: Dr Stephen Burke (RUTHERFORD APPLETON LABORATORY)

Slides GLUE-SRM.pdf GLUE-SRM.ppt

15:00 break

What do the experiments want from your storage?

This session will give a chance for sites to discover how the LHC experiments will use SRM2.2 storage. Contributions from ATLAS and CMS should talk about how they will use the Tier-2 disk. LHCb only require Tier-1 disk and tape.

Convener: Dr Flavia Donno (CERN)

15 ATLAS

Speaker: Dr Graeme A Stewart (University of Glasgow)

Slides atlas_srmv2.pdf

16 CMS

Speaker: Dr Giacinto Donvito (INFN-Bari)

Slides cms_tier2_smr2-2.pdf

17 LHCb

Speaker: Andrew Cameron Smith (University of Edinburgh)

Slides lhcb_srm2.2.pdf

Question and answer session

Specific use cases should be discussed. SRM1 to SRM2.2 transition should be mentioned.

Convener: Dr Greig Cowan (University of Edinburgh)

19:30 Workshop dinner

Participants should sign the sheet of paper when they arrive if they want to attend the dinner.

Directions from NeSC:

http://maps.google.co.uk/maps?daddr=25+George+St,+Edinburgh,+City+of+Edinburgh&geocode=&dirflg=&saddr=15+south+college+street&f=d&sll=55.953952,-3.195673&sspn=0.008109,0.022917&ie=UTF8&ll=55.950545,-3.191764&spn=0.00811,0.022917&z=16&om=1

Wednesday 14 November

DPM SRM2.2 configuration (1)

DPM configuration tutorial. Runs in parallel with the dCache one.

18 DPM configuration

Speakers: Jean-Philippe Baud (CERN), Sophie Lemaitre (Unknown)

Slides DPM-SRMv2.2-tutorial-Edinburgh-Nov-2007.pdf DPM-SRMv2.2-tutorial-Edinburgh-Nov-2007.ppt

19 DPM information publishing

Speaker: Dr Greig Cowan (University of Edinburgh)

Slides dpm_gip.pdf

dCache SRM2.2 configuration (1)

Parallel tutorials will be given for dCache and DPM sites. Developers will be on hand to answer specific questions. Sites should attend session appropriate for them.

20 dCache configruation

During session (2) participants should get the chance to ssh from their laptops into a pre-installed dCache instance and apply some of the material that has been presented in previous sessions. To enhance this experience, people should download the dCache administration client GUI: http://www.dcache.org/downloads/gui/index.shtml Select the "All dCache versions" link and follow the installation instructions.

Speakers: Owen Synge (Unknown), Dr Patrick Fuhrmann (DESY), Timur Perelmutov (FERMI NATIONAL ACCELERATOR LABORATORY)

Slides dCache.SRM.2.2.pdf

21 dCache information publishing

Speaker: Ron Trompert (SARA)

Slides dcacheinformation.pdf dcacheinformation.ppt

22 dCache pool metadata database

Introduction to the new dCache pool metadata databases which will replace the existing pool control files in a future release of dCache.

Speaker: Gerd Behrmann (NDGF)

Slides se_workshop_edinburgh.pdf

10:30 coffee break

DPM SRM2.2 configuration (2)

We may have the option of letting people loose on some test dCache and DPM installations in order to play about with the configuration of the service. Details of hostname and passwords will be provided to allow you to ssh into the hosts from your laptops.

23 DPM hands on

Configuration of SRM services will be presented. Reconfiguration should be discussed. Tips on running a DPM service and common error messages to look out for.

Speakers: Jean-Philippe Baud (CERN), Sophie Lemaitre (Unknown)

Paper dpm-handout.pdf

dCache SRM2.2 configuration (2)

We may have the option of letting people loose on some test dCache and DPM installations in order to play about with the configuration of the service. Details of hostname and passwords will be provided to allow you to ssh into the hosts from your laptops.

24 dCache hands on

Configuring SRM2.2 services. Main dCache concepts required. gPlazma configuration. Common error messages. During session (2) participants should get the chance to ssh from their laptops into a pre-installed dCache instance and apply some of the material that has been presented in previous sessions. To enhance this experience, people should download the dCache administration client GUI: http://www.dcache.org/downloads/gui/index.shtml Select the "All dCache versions" link and follow the installation instructions.

Speakers: Owen Synge (Unknown), Dr Patrick Fuhrmann (DESY), Timur Perelmutov (FERMI NATIONAL ACCELERATOR LABORATORY)

Paper dcache-handout.pdf

Slides dCacheSRMHandsOnSession.pdf

13:00 Lunch

SRM2.2 availability monitoring

25 Service availability monitoring

Storage related SAM tests.

Speaker: Dr Flavia Donno (CERN)

Slides SRMv2.2_monitoring.pdf SRMv2.2_monitoring.ppt

26 SRM2.2 testing

Speaker: Dr Flavia Donno (CERN)

Storage support: discussion

With the LHC data expected next year, it is essential that grid storage services have high availability and reliability such that physics analysis can be completed. During this session, ideas about the future of storage support within WLCG will be presented and discussed among the sites, middleware developers, experiments and WLCG representatives.

slides Storage_Management_Support.pdf Storage_Management_Support.ppt

SRM Client tools

Summary of the tools that will be interacting with the SE.

27 Client tools for SRM2.2 operations

Description of the client tools which users will use to interact with the SRMs and which site administrators can use to debug problems.

Speaker: Dr Greig Cowan (University of Edinburgh)

Slides cowan_srm_clients.pdf

28 FTS2

The EGEE File Transfer Service (FTS) will be presented. In particular Tier-1s and Tier-2s should find out how to debug problems involving the FTS. For example where to look for information (online FTS log files, monitoring plots) and what to look for (i.e. typical failure modes, error return codes).

Speaker: Paolo Tedesco (Unknown)

Slides FTS_SRM2.2_Deployment_Workshop_11-07.pdf FTS_SRM2.2_Deployment_Workshop_11-07.ppt

Workshop close

29 Workshop summary

Speaker: Dr Greig Cowan (University of Edinburgh)

Slides cowan_close.pdf

16:15 break

Coffee is available prior to participants leaving NeSC.