10–11 Nov 2022
Lancaster University, UK
Europe/London timezone

Session

Technology Sessions

Technology
10 Nov 2022, 13:30
Private Dining Room, County South Building (Lancaster University, UK)

Private Dining Room, County South Building

Lancaster University, UK

Conveners

Technology Sessions: Tech Stack

  • Martin Barisits (CERN)

Technology Sessions: Discussion of Metadata

  • Rob Barnsley

Technology Sessions: Discussion of Tokens

  • Cedric Serfon (Brookhaven National Laboratory (US))

Technology Sessions: Data Transfers

  • Mario Lassnig (CERN)

Description

Discussions of specific technologies and implementations within Rucio.

Presentation materials

There are no materials yet.

  1. Mario Lassnig (CERN)
    10/11/2022, 13:30
  2. Mr Julien Leduc (CERN)
    10/11/2022, 13:45

    CTA is the CERN Tape Archive solution in production for LHC Run-3.

    This presentation will focus on the current CTA production deployment and will provide an up-to-date snapshot of CTA achievements since the start of Run-3.

    It will also cover production deployment plans.

    Go to contribution page
  3. Cedric Serfon (Brookhaven National Laboratory (US))
    10/11/2022, 14:00
  4. Mayank Sharma (University of Texas at Arlington (US))
    10/11/2022, 14:15

    The good old Rucio WebUI has served our community well over the last several years. However, it lacks the architecture, frameworks, and technologies to sustain it over the next decade. That's where the efforts to revamp the old WebUI step in. This talk discusses the plan, progress, and what the users can expect from the new Rucio WebUI.

    Go to contribution page
  5. Timothy John Noble (Science and Technology Facilities Council STFC (GB))
    10/11/2022, 14:30

    Multi-Vo Rucio allows a single instance of Rucio serve several VOs. Each VO is separated into its own namespace, providing complete separation between the VOs data, and each VO with their own customisability with policy packages.

    Work is underway to ensure Multi-VO capabilities for the new WebUI, and integration with DIRAC workflow management software.
    The Multi-VO instance of Rucio is...

    Go to contribution page
  6. Frederic Gillardo (Centre National de la Recherche Scientifique (FR))
    10/11/2022, 14:45

    This document presents the work done during the Escape’s project by the CTA team in order to evaluate the integration of the ESCAPE’s Data Lake with the Workload Manager (DIRAC).
    The work was distributed across differents teams:
    -PIC in Barcelona was in charge of providing the Data Lake and storage infrastructure
    -DIRAC’s team has set up the DIRAC instance in CC-IN2P3
    -LAPP was in charge...

    Go to contribution page
  7. 10/11/2022, 15:00
  8. Rob Barnsley
    10/11/2022, 15:45
  9. David Morris
    10/11/2022, 16:00
    1. A brief overview of what the International Virtual Observatory (IVOA) is and what it has acheived.
    2. Describing work in progress looking at adapting IVOA services to include metadata from Rucio.
    3. Exploring opportunities for the future, using the IVOA architecture as a model for other domains.
    Go to contribution page
  10. Igor Mandrichenko (Fermi National Accelerator Lab. (US))
    10/11/2022, 16:15

    Metadata management is one of three major areas of scientific
    data management along with replica management and workflow
    management. Metadata is the information describing the data stored in a data
    item such as a file or an object. It includes the data item provenance, recording
    conditions, format and other attributes. MetaCat is a metadata management
    database designed and developed for...

    Go to contribution page
  11. Cedric Serfon (Brookhaven National Laboratory (US))
    10/11/2022, 16:30
  12. 10/11/2022, 16:45
  13. Doug Benjamin (Brookhaven National Laboratory (US)), Steven Timm (Fermi National Accelerator Lab. (US))
    10/11/2022, 17:15

    The DUNE Distributed Data management currently has 16 Rucio Storage Elements spread around the world, all currently using X.509 authentication. We have a local physics groups storage deployed at Fermilab that is using token authentication. We will present our current schema for file permissions at distributed storage elements, and how we expect this to change in the era of tokens. We will...

    Go to contribution page
  14. Martin Barisits (CERN), Dimitrios Christidis (CERN)
    10/11/2022, 17:25
  15. Maarten Litmaath (CERN)
    10/11/2022, 17:45
  16. 10/11/2022, 17:55
  17. Diego Davila Foyo (Univ. of California San Diego (US))
    11/11/2022, 09:00

    As distributed scientific collaborations reach the Exabyte scale, moving data becomes more challenging and thus, the capacity of managing priorities among the different transfer requests over the network becomes a necessity.
    Using network services to build bandwidth guaranteed paths and fixed routes can be used to prioritize transfer requests.
    We have built a system that creates such...

    Go to contribution page
  18. Y. Richard Yang
    11/11/2022, 09:15
  19. Shawn Mc Kee (University of Michigan (US))
    11/11/2022, 09:30

    Analyzing the HEP traffic flows in detail is critical for understanding how the various complex systems developed by the LHC experiments are actually using the network. In this talk we will describe the work of the Research Networking Technical Working Group in the area of packet marking and flow labeling. The goal is to enable identification of any research and education network traffic...

    Go to contribution page
  20. Radu Carpa (CERN)
    11/11/2022, 09:45

    The transfer subsystem of Rucio, also known as 'conveyor', was heavily reworked in the past year. This talk starts with a high level overview of Rucio transfers, followed by a deep dive into architectural changes and improvements implemented in recent Rucio releases.

    Go to contribution page
  21. Mihai Patrascoiu (CERN)
    11/11/2022, 10:00

    FTS presentation about the current state of affairs and planned changes for 2023 and after.

    Go to contribution page
  22. 11/11/2022, 10:15
Building timetable...