Focus on:  Hide Contributions
Back to Conference View
Login

4th Rucio Community Workshop (Virtual)

→ Europe/Zurich
Description

Rucio is a software framework that provides functionality to organize, manage, and access large volumes of scientific data using customisable policies. The data can be spread across globally distributed locations and across heterogeneous data centers, uniting different storage and network technologies as a single federated entity. Rucio offers advanced features such as distributed data recovery or adaptive replication, and is highly scalable, modular, and extensible. Rucio has been originally developed to meet the requirements of the high-energy physics experiment ATLAS, and is continuously extended to support LHC experiments and other diverse scientific communities.

We set up a mailing list to which you can subscribe and where we will send more details about the program in the coming weeks.

We also created a Slack channel dedicated to the workshop discussion on the Rucio Slack workspace (Invitation Link). Join #workshop.

Group Photo.png
Contact
Participants
117 View full list
4th Rucio Community Workshop (Virtual)
Zoom Meeting ID
66591244385
Host
Martin Barisits
Alternative hosts
Mario Lassnig, Cedric Serfon, Alastair Dewhurst
Useful links
Join via phone
Zoom URL
  • Tuesday 28 September
    • Opening & Closing
    • Community Reports
      Convener: Alastair Dewhurst (Science and Technology Facilities Council STFC (GB))
      • 4
        CMS
        Speaker: Eric Vaandering (Fermi National Accelerator Lab. (US))
        CMS Rucio WS 2021.pdf
        Recording
      • 5
        Rucio for the Light Dark Matter eXperiment (LDMX)

        The Light Dark Matter eXperiment (LDMX) is a planned small-scale accelerator-based experiment to search for dark matter in the sub-GeV mass region. Finalizing the design of the detector relies on Monte-Carlo simulation of expected physics processes. A distributed computing pilot project was initiated based around existing software used by other communities, including Rucio for data management. Rucio is primarily used as a dataset catalog, and LDMX also makes extensive use of Rucio metadata to record physics properties as well as bookkeeping information on the data produced. In this talk we describe how Rucio is used by LDMX and propose some possible extensions to the metadata functionality.

        Speaker: David Cameron (University of Oslo (NO))
        Recording
        Rucio for LDMX.pdf
      • 6
        DUNE Rucio Usage and Status

        We present the current state of the DUNE Rucio deployment and plans for extension and expansion. Results will include new monitoring and testing that has been
        added as well as plans for moving from the current hybrid system to a native
        Rucio deployment.

        Speaker: Steven Timm (Fermi National Accelerator Lab. (US))
        Recording
        rucio_wkshp_2021sep28.pdf
        rucio_wkshp_2021sep28.pptx
    • 16:30
      Break
    • Community Reports
      Convener: Mario Lassnig (CERN)
      • 7
        Customizing Rucio at LCLS

        This talk will present the speaker's onboarding experience as someone new to Rucio, covering the aspects of using documentation, building and standing up the containers, and configuring the Rucio system. Furthermore, specifics will be discussed in regard to the customization in development to meet the project requirements for LCLS, a free electron laser that produces ultra fast X-ray pulses.

        Speaker: Kenny Lo (SLAC National Accelerator Laboratory)
        LCLS_4thRucioWorkshop.pdf
        Recording
      • 8
        IGWN
        Speaker: Gabriele Gaetano Fronze' (INFN Torino (IT) and LIGO-Virgo-Kagra Collaboration (US/IT/JP))
        Recording
        RucioWorkshop2021-min.pdf
      • 9
        FTS: Updates, Direction and Plans
        Speaker: Mihai Patrascoiu (CERN)
        FTS_Rucio_Workshop_2021.pdf
        Recording
      • 10
        AAI/Tokens IAM
        Speaker: Andrea Ceccanti (Universita e INFN, Bologna (IT))
        20210928-IAM-Rucio-Workshop.pdf
        Recording
    • Panels: Rucio in a non-grid environment
      Convener: Cedric Serfon (Brookhaven National Laboratory (US))
      • 11
        Rucio in a non-grid environment panel
        Speakers: Alastair Dewhurst (Science and Technology Facilities Council STFC (GB)), Andrea Manzi, David Cameron (University of Oslo (NO)), Ilija Vukotic (University of Chicago (US)), Mario Lassnig (CERN), Oliver Keeble (CERN)
  • Wednesday 29 September
    • Keynote
      Convener: Mario Lassnig (CERN)
      • 12
        Pipe Dreams (and Nightmares)

        Australia's Academic and Research Network (AARNet) was established in 1989 and is widely regarded as the founder of the Internet in Australia and renowned as the architect, builder and operator of world-class network infrastructure for research and education.
        We are Australia's National Research and Education Network (NREN). We connect over one million users—researchers, faculty, staff and students—at institutions across Australia, supporting education and research across a diverse range of disciplines including high energy physics, climate science, genomics, radio astronomy and the arts.
        Nationally, AARNet interconnects Australian universities, the CSIRO, and other organisations who have a research and education mission, or with whom the education and research sector interacts. These include hospitals, vocational training providers, schools and museums. Internationally, AARNet interconnects the Australian Research and Education (R & E) community to the world – and continuously develops new capabilities and partnerships to facilitate seamless data access and transfer.
        Today, we'll talk about some of the work we've done in the data access and transfer space, challenges we've faced, and our plans for the future.

        Speaker: Crystal Michelle Chua
        cc_ga_rucio4.pdf
        Recording
    • Community Reports: WFMS
      Convener: Cedric Serfon (Brookhaven National Laboratory (US))
    • 11:05
      Break
    • Community Reports
      Convener: Martin Barisits (CERN)
    • Community Reports: Astronomy
      Convener: Rosie Bolton (SKA Organisation)
    • 16:40
      Break
    • Community Reports
      Convener: Eric Vaandering (Fermi National Accelerator Lab. (US))
      • 27
        ESCAPE Data Lake as a Service

        Experiments and scientists, whether in the process of designing and building up a data management system or managing multi-petabyte data historically, gather in the European Science Cluster of Astronomy & Particle physics ESFRI research infrastructures (ESCAPE) project to address computing challenges by developing common solutions in the context of the EOSC.
        A modular ecosystem of services and tools constitutes the ESCAPE Data Lake, which is exploited by flagship ESFRIs in Astro-particle Physics, Electromagnetic and Gravitational-Wave Astronomy, Particle Physics, and Nuclear Physics to pursue together the FAIR and open-access data principles.
        This infrastructure fulfils the needs of the ESCAPE community in terms of data organisation, management, and access, and dedicated assessment exercises demonstrated its robustness.
        As a result, collaborating sciences are choosing their reference implementations of the various technologies among the proposed solutions.
        A variety of challenges and specific use cases boost ESCAPE to carefully take into account both user and infrastructure perspectives, and contributed to successfully conclude the pilot phase beyond expectations, embarking on a like-production prototype stage.
        The ongoing phase of the project aims at consolidating the functionalities of the services, e.g. integrating token-based AuthN/Z or deploying a tailored content delivery and caching layer, and at simplifying the user experience. Specifically for this reason, a considerable effort is being devoted towards a DataLake-as-a-Service whose goal is to provide the end-user with a Notebook ready-to-be-used and fully integrated with the Data Lake.
        ESCAPE milestones achieved during the length of the project represent a fundamental accomplishment under both sociological and computing model aspects for different scientific communities that should address upcoming data management and computing challenges in the next decade.

        Speaker: Dr Riccardo Di Maria (CERN)
        ESCAPE Data Lake as a Service - 4th Rucio Community Workshop.pdf
        Recording
      • 28
        XENON
        Speaker: Paschalis Paschos (University of Chicago)
        Data management with Rucio for the XENON experiment
        Recording
      • 29
        GO/QoS/MAS
        Speaker: Matt Snyder (Brookhaven National Laboratory)
        Recording
        RucioCommunityWorkshop2021_MattSnyder.odp
        RucioCommunityWorkshop2021_MattSnyder.pdf
    • Panels: Astronomy & Metadata
      Convener: Rosie Bolton (SKA Organisation)
      • 30
        Astronomy & Metadata
        Speakers: Cedric Serfon (Brookhaven National Laboratory (US)), Dave Morris, Greg Daues (NCSA), Pandey Vishambhar (ASTRON), Rob Barnsley (SKAO)
  • Thursday 30 September
    • Community Reports: Long tail of science
      Convener: Alastair Dewhurst (Science and Technology Facilities Council STFC (GB))
    • 16:00
      Break
    • Panels: Transfer & Storage
      Convener: Mario Lassnig (CERN)
      • 35
        Transfer & Storage panel
        Speakers: Andrea Ceccanti (Universita e INFN, Bologna (IT)), Andrew Bohdan Hanushevsky (SLAC National Accelerator Laboratory (US)), Hannah Short (CERN), Martin Barisits (CERN), Mihai Patrascoiu (CERN), Paul Millar
    • Opening & Closing: Discussion, Photo and Closing
      Convener: Martin Barisits (CERN)
Powered by Indico v3.3.7-pre