Rucio Development Meeting

Thursday 24 Sept 2020, 15:00 → 16:00 Europe/Zurich

Martin Barisits (CERN)

Zoom: https://cern.zoom.us/j/413496641

Meeting ID: 413 496 641
Find your local number: https://cern.zoom.us/u/aT2QQfXAo

15:00 → 15:10 News

• Meeting schedule October
  • Oct 1
  • Oct 8 ATLAS Software & Computing week
  • Oct 15
  • Oct 22
  • Oct 29
• New Hotfix release (1.23.6.post1) yesterday
  • Second (hopefully last) attempt to fix multi-hop bring_online issue with multiple sources
• Second Token-based Auth Hackathon
  • For Rucio mostly focused on group-based auth
    • Development for that was already done
    • wlcg.groups scope request added to Rucio DOMA instance
• Next week 1.24.0 "Aquadonkey" planning

15:10 → 15:20 News from the experiments

• CMS
  • Strange issue with cms-test conveyor contacting Escape-rucio database
    • Monitoring issue? 
  • Continuing with migration
• ATLAS
  • No news
• Fermilab
  • Icarus (new experiment) starting to move data soon
  • Bringing them online soon
• Belle II
  • Testing migration procedure building the lfc hierarchy
  • Rucio integrated to BelleDirac
    • Can be adapted to Dirac(vanilla) later
• LDMX
  • Running simulation campaign next week
  • All well with Rucio
    • Pushing metadata there as well (json metadata)
  • ~1M file
  • JSON columns can be indexed (for common queries on the metadata)
• RAL/UK
  • Multi-VO instance running
    • New VO coming in (Imperial DIRAC team)
      • For Testing DIRAC functionality with Multi-VO Rucio

15:20 → 15:30 Hot topics

• Username/Password reset with Rucio 1.24
  • Unfortunately required due to a bug introduced in the past (See #3994)
  • Will be highlighted in the release notes

15:30 → 15:55 Developers roundtable

• FTS min/max configuration API
  • Caps for specific endpoints / sources could be set as attributes
  • For links it is more difficult though
    • Could be added to distances table
  • CMS: Might be useful in certain circumstances - but would be better in CRIC
• Better configuration interface
  • Still need to do collection of which information goes where
• Replica sorting (for list_replicas)
  • Change list_replicas to geoip sorting as default
  • Medium term: Do ranking based sorting (distances)
    • Offer distance based sorting and change it to default later on

15:55 → 16:00 AOB