Login

QoS Workshop

→ Europe/Zurich
513/1-024 (CERN)

513/1-024

CERN

50
Show room on map
Description

WLCG QoS Workshop

The purpose of the meeting is to stimulate WLCG's exploration the of potential of QoS, allowing better matching of systems to workflows and reducing the costs of storage provision. We hope to identify themes common at the experiment or site level which could benefit from coordinated action.

An updated version of the White Paper will be produced based on this and other feedback.

More information about QoS and the WLCG WG is available at https://twiki.cern.ch/twiki/bin/view/LCG/QoS

Call for contributions to the workshop

We would like to invite all stakeholders to present contributions relevant to storage QoS and its potential for WLCG.

Contributions dealing with the following topics are welcome:

  • Experiment experience and plans with QoS
    • Experiments are also requested to present their response to the White Paper
  • Storage provider features and roadmap
    • See below for further details
  • Site experience with QoS
    • See below for further details

Remote participation will of course be possible.

Please contact the organisers, Oliver Keeble (CERN) and Paul Millar (DESY), to schedule a contribution.

Further Information On Contributions

Storage Systems

We welcome all contributions from storage system providers, especially covering QoS-related topics such as:

  • Multi-replica files
  • Erasure encoding
  • Multiple-media operation (Tape, Fast SSD, etc)
  • User accessible QoS (Transitions, Media migrations)
  • Data Lifecycle (Automated QoS transitions)
  • Multi-site operation
    • Geo aware placement and replica management
  • Caching or volatile modes of operation

Site Contributions

We are particularly interested in contributions from sites about projects they have undertaken or conclusions they have reached regarding storage provision and cost.

In order to clarify the scope, here is a non-exhaustive list of possible topics:

  • Redundancy
    • Use of erasure coding in grid services
    • Experience with RAID and its sustainability
    • Integration of new redundancy layers in existing systems (e.g. Ceph behind DPM)
  • Media
    • Incorporation of novel media types
    • Consumer vs enterprise drives
    • SMR disks
    • Fast cache
  • Purchasing strategy
    • Server densification, reducing overheads
  • Data lake
    • Replica management and multi-site storage systems
    • Networking and implications for origin storage cost
  • Stack consolidation
    • Cost management through converging multiple user communities on the same system
  • Self-classification of novel QoS classes and suggestions of how they can be exploited by experiments
    • e.g. proposal for use of post-warranty hardware or new media types
    • requests for use of novel (to WLCG) systems such as S3, offers of test services

 

Registration
Registration (only required if attending in person)
Register
    • 9:00 AM → 9:20 AM
      QoS Overview and White Paper 20m
      Speaker: Paul Millar
      QoS and whitepaper.pdf
    • 9:20 AM → 9:40 AM
      Community managed QoS & FTS (XDC project) 20m
      Speaker: Oliver Keeble (CERN)
      QoS_FTS.pdf
    • 9:40 AM → 10:00 AM
      dCache and QoS 20m
      Speaker: Paul Millar
      dCache and QoS.pdf
    • 10:00 AM → 10:20 AM
      EOS : Erasure encoding & QoS features (XDC project) 20m
      Speaker: Mihai Patrascoiu
      EOS - Erasure Coding and QoS features.pdf
    • 10:20 AM → 11:10 AM
      Coffee 50m
    • 11:10 AM → 11:30 AM
      QoS in Rucio 20m
      Speaker: Martin Barisits (CERN)
      QoS in Rucio and ATLAS.pdf
    • 11:30 AM → 11:50 AM
      Storage QoS in StoRM 20m
      Speaker: Enrico Vianello
      storm-qos.pdf
    • 11:50 AM → 12:10 PM
      LHCb view 20m
      Speaker: Christophe Haen (CERN)
      lhcbView.pdf
    • 12:10 PM → 12:30 PM
      CMS view 20m
      Speaker: Nick Smith (Fermi National Accelerator Lab. (US))
      QoS Workshop February 2020.pdf
    • 12:30 PM → 2:00 PM
      Lunch 1h 30m
    • 2:00 PM → 2:20 PM
      Alice view 20m
      Speaker: Nikola Hardi (CERN)
      DOMA_QoS Workshop 2020 - ALICE view.pdf
    • 2:20 PM → 2:40 PM
      INFN Roma & QoS 20m
      Speaker: Alessandro De Salvo (Sapienza Universita e INFN, Roma I (IT))
      INFN-ROMA1 QoS plans-20200207.pdf
    • 2:40 PM → 3:00 PM
      J. Stefan Institute & QoS 20m
      Speaker: Andrej Filipcic (Jozef Stefan Institute (SI))
      QoS@JSI (1).pdf
    • 3:00 PM → 3:20 PM
      MAS (Multilayer Automated Storage) 20m
      Speaker: Eric Christian Lancon (Brookhaven National Laboratory (US))
      MAS-QoS-workshop-Feb-2020.pdf
    • 3:20 PM → 3:40 PM
      Kisti & QoS 20m
      Speaker: Mr Heejune Han (Korea Institute of Science & Technology Information (KR))
      GSDC_ATAS_EOS_v1.0.pdf
    • 3:40 PM → 4:00 PM
      Discussion, Conclusions, Actions 20m
Powered by Indico v3.2.4-pre