Login

3rd Rucio Community Workshop

10–12 Mar 2020
Fermilab
US/Central timezone

Contact

Contribution List

40 out of 40 displayed
Export to PDF
  1. 19. Welcome to Fermilab
    Elizabeth Sexton-Kennedy (Fermi National Accelerator Lab. (US))
    10/03/2020, 09:00
  2. 20. Logistics
    Gabriele Benelli (Brown University (US))
    10/03/2020, 09:20
  3. 21. Introduction
    Martin Barisits (CERN)
    10/03/2020, 09:30
  4. 22. Keynote I: Quantum Computing at Fermilab
    Dr Adam Lyon (Fermilab)
    10/03/2020, 09:45
  5. 23. ATLAS (Remote)
    David Michael South (Deutsches Elektronen-Synchrotron (DE)), Mario Lassnig (CERN)
    10/03/2020, 11:00
  6. 24. ESCAPE Project (Remote)
    Aristeidis Fkiaras (CERN)
    10/03/2020, 11:20

    The ESCAPE European Union funded project aims at integrating facilities of astronomy, astroparticle and particle physics into a single collaborative cluster or data lake. The data requirements of such data lake are in the exabyte scale and the data should follow the FAIR principles (Findable, Accessible, Interoperable, Re-usable). To fulfill those requirements significant RnD is foreseen with...

    Go to contribution page
  7. 25. DUNE Data Management Experience with Rucio
    Steven Timm (Fermi National Accelerator Lab. (US))
    10/03/2020, 11:40

    The DUNE collaboration has been using Rucio since 2018 to transport data to our many European remote storage elements. We currently have 13.8 PB of data under Rucio management at 13 remote storage elements. We present our experience thus far, as well as our future plans to make Rucio our sole file location catalog.
    We will present our planned data discovery system, and the role of Rucio in...

    Go to contribution page
  8. 26. Using Rucio for LCLS (Remote)
    Wilko Kroeger (SLAC National Accelerator Laboratory)
    10/03/2020, 12:00

    We will describe our plans for using RUCIO within the data management system at the Linac Coherent Light Source (LCLS) at SLAC. An overview of the LCLS data management system will be presented and what role RUCIO will play for cataloging, distributing and archiving of the data files. We are still in the testing phase but plan to use RUCIO in production within the next few month.

    Go to contribution page
  9. 27. Kubernetes & Rucio (Remote)
    Thomas Beermann (Bergische Universitaet Wuppertal (DE))
    10/03/2020, 13:30
  10. 28. Tales From ATLAS DDM Operations (Remote)
    Dimitrios Christidis (University of Texas at Arlington (US))
    10/03/2020, 13:45
  11. 29. CRIC: Computing Resource Information Catalogue as a topology system for computing infrastructures and an interface for effortless Rucio configuration (Remote)
    Panos Paparrigopoulos (CERN)
    10/03/2020, 14:00

    CRIC is a high-level information system which provides flexible, reliable and complete topology and configuration description for a large scale distributed heterogeneous computing infrastructure. CRIC aims to facilitate distributed computing operations for HEP experiments and consolidate WLCG topology information. Being a topology framework, CRIC offers a generic solution with out of the box...

    Go to contribution page
  12. 30. Discussion
    10/03/2020, 14:20
  13. 31. Belle II (Remote)
    Cedric Serfon (Brookhaven National Laboratory (US))
    10/03/2020, 14:40
  14. 32. Data Management Needs in Cancer Research (Remote)
    Arfath Pasha (MSKCC)
    10/03/2020, 15:00

    MSKCC's Computational Oncology group performs prospective and retrospective studies on a number of cancer types with a focus on cancer evolution. The data being collected and managed for research comes from many sources. Broadly, the data may be categorized into molecular, imaging and clinical data types. The studies tend to be cross-sectional and longitudinal. Users require heterogenous...

    Go to contribution page
  15. 1. Keynote: ESnet: DOE's data circulatory system
    Inder Monga (ESNet)
    11/03/2020, 09:00
  16. 37. Rucio at RAL and the UK
    Katy Ellis (Science and Technology Facilities Council STFC (GB))
    11/03/2020, 09:45
  17. 38. CMS Transition to Rucio
    Eric Vaandering (Fermi National Accelerator Lab. (US))
    11/03/2020, 10:05

    An update on the CMS transition to Rucio, expected to be completed this year, will be given.

    Results of scale tests, data consistency work, and improvements in the kubernetes infrastructure will be the focus of this talk.

    Go to contribution page
  18. 39. EGI data management requirements and plans (Remote)
    Andrea Manzi
    11/03/2020, 11:00

    The Data Management requirements coming from the EGI and EOSC-Hub user communities have pictured Rucio (together with a Data transfer engine) as one of the possible solutions for their needs. Since the 2nd Rucio workshop a number of enhancements and new developments (in primis the support for OIDC and the kubernetes deployment improvements) have been implemented and they are going towards the...

    Go to contribution page
  19. 40. iDDS: A New Service with Intelligent Orchestration and Data Transformation and Delivery (Remote)
    Wen Guan (University of Wisconsin (US))
    11/03/2020, 11:20

    The Production and Analysis system (PanDA system) has continuously been evolving in order to cope with rapidly changing computing infrastructure and paradigm. The system is required to be more dynamic and proactive to integrate emerging workflows such as data carousel and active learning, in contrast to conventional HEP workflows such as Monte-Carlo simulation and data...

    Go to contribution page
  20. 41. Rucio-DIRAC Integration at Belle II (Remote)
    Cedric Serfon (Brookhaven National Laboratory (US))
    11/03/2020, 11:40
  21. 42. Discussion
    11/03/2020, 11:50
  22. 33. dCache QoS and Storage Events
    Dmitry Litvintsev (Fermi National Accelerator Lab. (US))
    11/03/2020, 13:30

    dCache is highly scalable distributed storage system that is used to
    implement storage elements with and without tape back-ends.
    dCache is offering a comprehensive RESTFul data management interface
    that uses language of QoS states and transitions to steer the data
    life-cycle. This interface provides functionality inspired by the
    experiences of the LHC and other data intensive experiments....

    Go to contribution page
  23. 14. Operational Intelligence - General Introduction
    Federica Legger (Universita e INFN Torino (IT))
    11/03/2020, 13:30

    In the near future, large scientific collaborations will face unprecedented computing challenges. Processing and storing exabyte datasets require a federated infrastructure of distributed computing resources. The current systems have proven to be mature and capable of meeting the experiment goals, by allowing timely delivery of scientific results. However, a substantial amount of interventions...

    Go to contribution page
  24. 16. Automation of Rucio operations
    Dimitrios Christidis (University of Texas at Arlington (US))
    11/03/2020, 13:50
  25. 34. CERN Tape Archive status and plans (Remote)
    Julien Leduc (CERN)
    11/03/2020, 13:50

    CTA is designed to replace CASTOR as the CERN Tape Archive solution, in order to face scalability and performance challenges arriving with LHC Run-3.

    This presentation will focus on the current CTA deployment and will provide an up-to-date snapshot of CTA achievements.

    It will also cover the final Run3 CTA Service architecture and underlying hardware that have been deployed at the end of 2019.

    Go to contribution page
  26. 35. Connecting Xcache and RUCIO for User Analysis (Remote)
    Wei Yang (SLAC National Accelerator Laboratory (US))
    11/03/2020, 14:10
  27. 15. Framework Design
    Panos Paparrigopoulos (CERN)
    11/03/2020, 14:15

    This contribution describes how and why we decided to create the “OpInt Framework", what it offers and how we architected it. Last year we began the development of the "Rucio OpInt" project in order to optimise the operational effort and minimize human interventions in the distributed data management.
    When we brought "Rucio OpInt" to the Operational intelligence forum we realized that there...

    Go to contribution page
  28. 36. Discussion
    11/03/2020, 14:30
  29. 17. JobsBuster
    Siarhei Padolski (BNL)
    11/03/2020, 14:40

    Reliable automatization of the root cause analysis procedure is an essential prerequisite for the Operational Intelligence deployment. That kind of data processing is important as an input for the automatic decision making and has its own value as an instrument for offloading shifters operations. The order of magnitude of failing rate in distributed computing, for instance in ATLAS experiment,...

    Go to contribution page
  30. 18. Job outcome prediction with Google's AutoML Tables
    Kevin Michael Retzke (Fermi National Accelerator Lab. (US)), Shreyas Bhat
    11/03/2020, 15:05
  31. 52. CANCELLED: Fermilab Colloquium: The Science of LSST and the big data it will produce
    11/03/2020, 16:00

    https://events.fnal.gov/colloquium/events/event/open-17/

    Go to contribution page
  32. 43. IceCube
    David Schultz (University of Wisconsin-Madison)
    12/03/2020, 09:00
  33. 44. Data management for the XENON Collaboration with Rucio
    Paschalis Paschos (University of Chicago)
    12/03/2020, 09:20

    The search for Dark Matter in the XENON experiment at the LNGS laboratory in Italy enters a new phase, XENONnT in 2020. Managed by the University of Chicago, Xenon's Rucio deployment plays a central role in the data management between the collaboration's end points. In preparation for the new phase, there have been notable upgrades in components of the production and analysis pipeline and they...

    Go to contribution page
  34. 45. Rucio at BNL and NSLS2 (Remote)
    Matthew Snyder (Brookhaven National Laboratory)
    12/03/2020, 09:40

    Rucio has evolved as a distributed data management system to be used by scientific communities beyond High Energy Physics. This includes disengaging its core code from a specific file transfer tool. In this talk I will discuss using Globus Online as a file transfer tool with Rucio, the current state of testing and the possibilities for the future in light of NSLSII's data ecosystem

    Go to contribution page
  35. 46. Rucio @ LIGO-Virgo-KAGRA (Remote)
    Mr Gabriele Gaetano Fronze' (University e INFN Torino (IT), Subatech Nantes (FR))
    12/03/2020, 10:00
  36. 47. FTS news and plans (Remote)
    Edward Karavakis (CERN)
    12/03/2020, 11:00

    The File Transfer Service (FTS) is distributing the majority of the LHC data across the WLCG infrastructure and, in 2019, it has transferred more than 800 million files and a total of 0.95 exabyte of data. It is used by more than 28 experiments at CERN and in other data-intensive sciences outside of the LHC and even the High Energy Physics domain.

    The FTS team has been very active in...

    Go to contribution page
  37. 48. Multi-VO Rucio
    Eli Benjamin Chadwick (Science and Technology Facilities Council STFC (GB))
    12/03/2020, 11:20
  38. 50. Rucio Roadmap (Remote)
    Martin Barisits (CERN)
    12/03/2020, 11:40
  39. 51. Discussion
    12/03/2020, 12:00
  40. 49. Rucio FUSE Interface (Remote)
    Gabriele Gaetano Fronze' (University e INFN Torino (IT), Subatech Nantes (FR))