WLCG Workshop 2017

19 Jun 2017, 12:00 → 22 Jun 2017, 17:30 Europe/London

University of Manchester

WLCG workshop in Manchester will cover with some in depth discussion medium term plans and long term developments with particular focus on cooperation with Astronomers in particular with SKA which has a strong presence in Manchester. The workshop will start at lunchtime on Monday June 19th. The main workshop will end on Wednesday afternoon. On Thursday June 22nd there will be an IPv6 workshop, including hands on training. On Thursday afternoon there will be a tour of Jodrell Bank Observatory (JBO - http://www.jodrellbank.net/) for up to 30 people (who register first).

Monday, 19 June

Registration

Introduction

1 Welcome

Speaker: Stefan Soldner-Rembold (University of Manchester)

2 Logistic

Speaker: Alessandra Forti (University of Manchester (GB))

20170619_logistic.pdf

3 Introduction

Speakers: Ian Bird (CERN), Ian Collier (STFC - Rutherford Appleton Lab. (GB))

WLCG-WorkshopIntro-Man-190617.pdf

WLCG-WorkshopIntro-Man-190617.pptx

Medium term evolution - Compute

TOPICS BEING CONSIDERED

• General review of compute models and commonalities of the LHC experiments. Input from Community White Paper ongoing work.

• Square Kilometre Array (SKA) Compute model - opportunities for common work

• Lightweight site review for Compute

• Mid-SLA compute - running on disk-servers - is there a place for pre-emption in our models to help us make better use of resources?

• External clouds: how can we make more use of them? Where do they fit in our models? What should we do there? How to procure/access them (via traditional sites or directly)?

• Use of containers (Singularity / Docker). Operational perspectives.

  • Replace glExec
  • Input to kick-off Container WG.
  • ..merging to security session on containers afterwards.

Convener: Gavin McCance (CERN)

4 European SKA Regional Centre Compute Model

Speaker: Anna Scaife

AENEAS-ComputeModel-170619.pdf

5 Discussion

6 Review of WLCG experiment compute plans

Speaker: Simone Campana (CERN)

WLCGworkshop-Jun2017-WM.pdf

WLCGworkshop-Jun2017-WM.pptx

7 Discussion

8 Lightweight sites compute - possible models

Speaker: Maarten Litmaath (CERN)

LW-comp-res-v10.pdf

LW-comp-res-v10.pptx

9 Discussion

15:00 Coffee

Medium term evolution - Compute: Medium term evolution - Compute (continuation)

TOPICS BEING CONSIDERED

• General review of compute models and commonalities of the LHC experiments. Input from Community White Paper ongoing work.

• Square Kilometre Array (SKA) Compute model - opportunities for common work

• Lightweight site review for Compute

• Mid-SLA compute - running on disk-servers - is there a place for pre-emption in our models to help us make better use of resources?

• External clouds: how can we make more use of them? Where do they fit in our models? What should we do there? How to procure/access them (via traditional sites or directly)?

• Use of containers (Singularity / Docker). Operational perspectives.

  • Replace glExec
  • Input to kick-off Container WG.
  • ..merging to security session on containers afterwards.

Convener: Gavin McCance (CERN)

10 Singularity introduction and use in OSG

Speaker: Brian Paul Bockelman (University of Nebraska-Lincoln (US))

Singularity-on-OSG-WLCG-Workshop-June-2017.pdf

11 Use of containers at RAL Tier-1

Speaker: Andrew David Lahiff (STFC - Rutherford Appleton Lab. (GB))

UseOfContainersAtRALTier1.pdf

12 Discussion

containerwg.pdf

containerwg.pptx

Medium term evolution - Security and trust

Topics to include:
Singularity
Collaboration between security teams
Ongoing work

Convener: David Crooks (University of Glasgow (GB))

13 Security update [slides for all talks]

Speakers: Liviu Valsan (CERN), Romain Wartel (CERN), Vincent Brillault (CERN)

201706 Wartel Brillault Valsan WLCG WS.pdf

14 Singularity

Speakers: Liviu Valsan (CERN), Vincent Brillault (CERN)

15 Collaboration between security teams

Speaker: Romain Wartel (CERN)

16 Ongoing work

Speaker: Liviu Valsan (CERN)

19:30 Reception

Tuesday, 20 June

Medium term evolution - Data

Convener: Oliver Keeble (CERN)

17 Overview & report from Data Steering Group

Speaker: Oliver Keeble (CERN)

Steering.pdf

Steering.pptx

18 Discussion

19 Storage resource reporting

Speaker: Oliver Keeble (CERN)

ResRep.pdf

ResRep.pptx

20 Discussion

21 Object stores

Speaker: Alastair Dewhurst (STFC - Rutherford Appleton Lab. (GB))

WLCGObjectStores20170620.pdf

22 Discussion

10:30 Coffee

Medium term evolution - Data: Medium term evolution - Data (continuation)

Convener: Oliver Keeble (CERN)

23 SKA data management

Speaker: Rosie Bolton

Bolton_WLCG-workshop_SKA_Data_flow.pptx.pdf

24 Site and storage architecture - multi-site storage

Speaker: Tigran Mkrtchyan (DESY)

distributed-dcache.pdf

25 Site and storage architecture - caches

Speaker: Brian Paul Bockelman (University of Nebraska-Lincoln (US))

DataCaches-WLCG-Workshop-June-2017.pdf

26 Site and storage architecture - regional federations

Speaker: Randy Sobie (University of Victoria (CA))

Sobie-WLCG.pdf

27 Site and storage architecture - diskless sites

Speaker: Emmanouil Vamvakopoulos (CC-IN2P3 - Centre de Calcul (FR))

WLCG_2017_DISKLESS_EV_final.pdf

28 Discussion

12:30 Lunch

Medium term evolution - Network: WLCG Network Requirements

We will have a networking session to present-on and discuss medium term networking areas for WLCG (3-5 year time frame). This will include a presentation from SKA about their networking requirements and potential areas for mutual effort, the status and plans for network monitoring and analytics, a set of brief presentations on the experiments requirements and a concluding discussion session covering the needs of the experiments for network monitoring and diagnosis which can also serve as input for finalizing the community white paper to ensure it includes networking needs from WLCG.

Conveners: Shawn Mc Kee (University of Michigan (US)), Tony Cass (CERN)

29 SKA Networking Requirements

I will talk about networks within the telescope, the inter-continental network needs, and the work going on in the AENEAS project which is forming a design for the SKA European Science Data Centre. I will also discuss the basic needs and cover areas of possible collaboration with WLCG on networking.

Speaker: Richard Hughes-Jones (GEANT)

AENEAS-SKA_Networking_WLCG_19-21Jun17_v3.pdf

AENEAS-SKA_Networking_WLCG_19-21Jun17_v3.pptx

30 ATLAS Networking Requirements

ATLAS networking needs for the experiment and the sites.

Speaker: Alastair Dewhurst (STFC - Rutherford Appleton Lab. (GB))

WLCGNetwork20170620.pdf

31 ALICE Network Requirements

Speaker: Latchezar Betev (CERN)

ALICE_network_T2_WLCG_WS_Manchester_2017.pdf

ALICE_network_T2_WLCG_WS_Manchester_2017.pptx

32 CMS Networking Requirements

CMS Networking Requirements

Speaker: Christoph Wissing (Deutsches Elektronen-Synchrotron (DE))

CMS-Networking.pdf

33 LHCb Networking Requirements

LHCb Networking Requirements

Speaker: Stefan Roiser (CERN)

20170620-WLCGWorkshop-LHCbT2Networking.pdf

34 WLCG Network Monitoring and Analytics

We will present on the status and plans for WLCG network monitoring and analytics. The goal is to identify missing requirements from the experiments and sites as well as missing effort to deliver on the requirements.

Speaker: Shawn Mc Kee (University of Michigan (US))

WLCG_workshop-networking.pdf

WLCG_workshop-networking.pptx

35 Network Monitoring and Debugging Discussion

Discussion of network monitoring and diagnosis

WLCG_workshop-networking-discussion.pdf

WLCG_workshop-networking-discussion.pptx

15:30 Coffee

Efficiency and cost

Short introductions to three related topics with sufficient room for discussions

Convener: Markus Schulz (CERN)

Intro.pdf

Intro.pptx

36 Cost Models

To be able to predict the needs of computing and to understand which type of resources contribute to the overall costs, several models have been developed and are in use. Can we build models based on a common approach between the experiments and to what detail do we need to go? Short presentation followed by a discussion.

Speaker: Jose Flix Molina (Centro de Investigaciones Energéti cas Medioambientales y Tecno)

WLCG_Costs_Models.pdf

37 Bringing improvements into production

In our community we often observe a significant latency between the proof of concept of an improvement and the exploitation in production, while we often react to emergencies swiftly. Do we understand the underlying causes and what could be done to benefit more timely from improvements? Short presentation followed by a lively discussion.

Speaker: Johannes Elmsheuser (Brookhaven National Laboratory (US))

m_200617.pdf

38 Exchanging and disseminating knowledge

In many places, conferences, summer schools, workshops over many years findings on performance and efficiency are presented and techniques and tools are taught. There is a lot of knowledge and experience in our community, however this knowledge is fragmented and often web searches are the way to connect these sources. To achieve the improvements to successfully face the HL-LHC challenges this knowledge needs to more easily accessible and made usable for contributors at all levels. How can we achieve this? Very short presentation followed by a discussion and hopefully a seed for a plan.

Speaker: Markus Schulz (CERN)

20170620-WLCGWorkshop-LHCbOptimization.pdf

SharingAndTeaching.pdf

SharingAndTeaching.pptx

19:30 Conference Dinner

Wednesday, 21 June

Collaboration board

Rutherford lecture theatre

Convener: Roger Jones (Lancaster University (GB))

39 Project Leader's report

Speaker: Ian Bird (CERN)

40 Update on HNSciCloud

41 The Scientific Computing Forum

42 Relationship with other proejcts, including SKA

Discussion with Astronomers

Moseley room

Convener: Anna Scaife (University of Manchester)

Operational tools, benchmarking, accounting, monitoring, etc...: Benchmarking discussion

Conveners: Domenico Giordano (CERN), Jose Flix Molina (Centro de Investigaciones Energéti cas Medioambientales y Tecno)

43 Status report from Benchmarking Working Group

Speaker: Domenico Giordano (CERN)

WLCG_Workshop_2017_benchmarking_giordano.pdf

44 Benchmarking discussion (with panellists)

Speakers: Alessandra Forti (University of Manchester (GB)), Andrew McNab (University of Manchester), Betev Latchezar (CERN), Jose Flix Molina (Centro de Investigaciones Energéti cas Medioambientales y Tecno), Manfred Alef (Karlsruhe Institute of Technology (KIT))

WLCG_Workshop_2017_benchmarking_survey.pdf

12:30 Lunch

Operational tools, benchmarking, accounting, monitoring, etc...: Monitoring

Conveners: Alberto Aimar (CERN), Jose Flix Molina (Centro de Investigaciones Energéti cas Medioambientales y Tecno)

45 Status, plans of WLCG Unified Monitoring

Speaker: Alberto Aimar (CERN)

MONIT_Summary_Slides.pdf

MONIT_Summary_Slides.pptx

46 ElasticSearch Service at CERN

Speaker: Ulrich Schwickerath (CERN)

elastic.pdf

47 Monitoring in Experiments (Summary)

Speaker: Alberto Aimar (CERN)

Experiments_Summary_Slides.pdf

Experiments_Summary_Slides.pptx

48 Q&A

Operational tools, benchmarking, accounting, monitoring, etc...: IS evolution and storage space accounting

Conveners: Jose Flix Molina (Centro de Investigaciones Energéti cas Medioambientales y Tecno), Julia Andreeva (CERN)

49 Information System Evolution

Speaker: Julia Andreeva (CERN)

ISEvolutionWLCGWS.pdf

ISEvolutionWLCGWS.pptx

50 CRIC

Speaker: Alessandro Di Girolamo (CERN)

CRIC at WLCG wrkshp June 2017.pdf

51 Storage Space Accounting - Introduction

Speaker: Julia Andreeva (CERN)

StorageSpaceAccountingWLCGWS.pdf

StorageSpaceAccountingWLCGWS.pptx

52 Storage Space Accounting - Prototype

Speaker: Mr Dimitrios Christidis (University of Patras (GR))

WLCG Storage Space Accounting Prototype.pdf

53 Coffee

Introduction: IPv6 Introduction

Conveners: Andrea Sciaba (CERN), Dave Kelsey (STFC - Rutherford Appleton Lab. (GB))

54 WLCG and IPv6

Speakers: Alastair Dewhurst (STFC - Rutherford Appleton Lab. (GB)), Andrea Sciaba (CERN)

IPv6WLCGWorkshop20170621.pdf

55 An introduction to IPv6

Speaker: Mr Terry Froy (Queen Mary University of London)

20170621-wlcg-introductiontoipv6.pdf

56 Deploying IPv6

Speaker: Francesco Prelz (Università degli Studi e INFN Milano (IT))

Slides

57 DHCPv6 at CERN

Speaker: Edoardo Martelli (CERN)

WLCG-20170621-IPv6-training-DHCPv6.odp

WLCG-20170621-IPv6-training-DHCPv6.pdf

58 Hands-on preparation

Thursday, 22 June

IPv6 Tutorial

Conveners: Andrea Sciaba (CERN), Dave Kelsey (STFC - Rutherford Appleton Lab. (GB))

59 Preliminary steps

Speaker: Mr Terry Froy (Queen Mary University of London)

20170621-wlcg-preliminarysteps.pdf

60 Data transfer exercise

Speaker: Ulf Bobson Severin Tigerstedt (Helsinki Institute of Physics (FI))

foo.pdf

61 perfSonar exercise (installation)

Speaker: Duncan Rand (Imperial College (GB))

WLCG IPv6 training: perfSONAR

Coffee

IPv6 Tutorial

Part 2

Conveners: Andrea Sciaba (CERN), Dave Kelsey (STFC - Rutherford Appleton Lab. (GB))

62 perfSonar exercise (configuration)

Speaker: Duncan Rand (Imperial College (GB))

63 squid for Frontier and CVMFS

Speaker: Andrea Sciaba (CERN)

Google doc

HowtoinstallandusesquidforCVMFSandFrontieronIPv6.pdf

12:30 Lunch

Visit to Jodrell Bank