GridPP Technical Meeting - Rucio

Europe/London
Virtual Only

Virtual Only

Alastair Dewhurst (Science and Technology Facilities Council STFC (GB)), Andrew McNab (University of Manchester), David Colling (Imperial College Sci., Tech. & Med. (GB))
Description

Weekly meeting slot for technical topics. We will try and focus on one topic per meeting.  We will announce at the Tuesday Ops meeting if this meeting is going ahead and if so the topic to be discussed.

Alastair gave an update on the work ongoing at RAL (slides on the agenda).

 

James Perry gave an update on his work goals:

1) Bring the object store code in Rucio in line with the rest of the code.  S3 code is rather adhoc etc.
2) Deletions
3) Third Party Copy
4) Performance testing
5) How to benfit from object stores directly

There was a discussion about how RAL are planning on using DynaFed to make S3 look like a regular Grid endpoint.  Alastair agreed to attach his recent DynaFed slides to the meeting agenda.

Teng is looking at Rucio monitoring and has found there is very little documentation.  Teng has categorised his monitoring in two ways:

1) Rucio internal metrics (e.g. to make sure the Rucio instance is working).

2) Data usage, transfers etc.  ATLAS have a very complicated setup, Teng is looking at something much more straight forward for DUNE.  This is something we could copy at RAL.  Pete Clarke is likely to submit a Rucio Monitoring digital asset proposal in the next round of IRIS funding.

 

There are minutes attached to this event. Show them.
    • 11:00 11:15
      Rucio development work at Edinburgh 15m
      Speaker: James Perry (University of Edinburgh)
    • 11:15 11:30
      Rucio at RAL 15m
      Speaker: Alastair Dewhurst (Science and Technology Facilities Council STFC (GB))
    • 11:30 11:45
      Rucio F2F plans 15m
      Speakers: Alastair Dewhurst (Science and Technology Facilities Council STFC (GB)), James Perry (University of Edinburgh)
    • 11:45 12:00