Rucio Development Meeting

Thursday 10 Jan 2019, 15:00 → 16:30 Europe/Zurich

4/S-056 (CERN)

Martin Barisits (CERN)

1 News

• Happy new year!
• New meeting room 
  • 4-S-056
• Meeting plan for the next 3 month
  • Meeting every week unless cancelled!
  • 17.01. Discussion of Oracle plans (ATLAS & CMS)
  • 24.01. Github a-thon
  • 07.02. Rucio 1.20.0 "Wonder Donkey" Release Planning
  • 28.02. CANCELLED (Rucio Workshop)
  • 07.03. Possibly cancelled due to ATLAS Sites Jamboree
  • 21.03. CANCELLED (HSF/WLCG Workshop)
• Rucio Community Workshop in preparation

2 News from the experiments

• ATLAS
  • Was running quite stable over the holidays
  • Some issues with FTS identified
• CMS
  • Setup the WebUI server made some problems
    • WebUI standalone docker
  • Thomas will spent some more time on the WebUI container

3 Hot topics

4 Developers roundtable

• 1.19.0 "Fantastic Donkey" priority followup
  • Rucio mover
    • Some issues with timeouts
      • Turned off for ATLAS over Christmas
    • Problem with threads and protocols which do not "guarantee" timeout
    • Not sure what happens if a "control-thread" kills download threads
      • gfal might keep running
      • To be tested
    • Pilot
    • Nicolo will try out thread killing
    • Problem with non-detailed expections
      • Logger object needs to be passed through to DownloadClient
    • Pilot2 development (Adding all the features from P1 to P2)
  • ZIP File support #1091
    • Look quite good
    • Tomas first method can be removed
  • Register replica after upload #1599
    • Need to notify people that this is available
  • Temporary unavailable replicas #1550
    • Some tests and one bin missing
    • Review important, but difficult
  • Export/Import of json schema #716
    • Export one full schema and then sit together with CRIC developers
    • Import will need some work on conflict resolution
    • checksum behaviour
  • Partitioning/Full heartbeat support of reaper #529
    • Cedric has a proposal, should be discussed in the next meeting
  • Fill contents history when deleting last replica #37
    • Need to find somebody to work on this
  • Get rid of unused dockers
    • Linking of builds?
    • New fts-cron
    • Remove experiment specific clients
      • Add a common client docker, which people can use
    • Rucio-demo?
      • Keep
  • Migrate probes to separate repo #1638
    • Should be possible for 1.19.
  • Automatic recovery of suspicious files #403
  • Better way to deal with configuration/permissions #533
•  

5 AOB

• Rucio Journal Paper
  • Last reviews being added; Should be finished very soon!
• Oracle plans next week!