Rucio Meeting

Europe/Zurich
Martin Barisits (CERN)
Zoom Meeting ID
413496641
Host
Martin Barisits
Alternative hosts
Mario Lassnig, Cedric Serfon, Dimitrios Christidis
Passcode
28849311
Useful links
Join via phone
Zoom URL
    • 15:00 15:05
      News 5m
    • 15:05 15:25
      Community News & DevOps roundtable 20m
      • ATLAS
        • Noting to report
        • Interesting Accept header issue with Java 12 REST calls
          • Includes an malformed accept header, workaround: overwrite the accept header on client side
      • CMS
        • On 1.31.3 moving soon
      • Fermilab & Co
        • Student working on rucio interactions
          • Quite random issues (Truncated response headers)
            • e.g. list_parent_dids (only one did) - still crash
            • Streaming issue?
            • Failure of communication between backend and frontend
        • MU2E still configuring
        • RUBIN
          • Data butler code integration
        • update-rule boost times out on very large rules
          • Ticket # boost_rule written inefficiently
      • Belle II
      • ALTO (Richard Yang, Yale U)
        • Slides will be shown next week
        • 3 topics worked on at the moment (Feedback welcome)
          • (1) Network (with Shawn & co)
            • Perfsonar monitoring - goal is to show topology and performance
            • For Rucio: Have better (and dynamic) distances in Rucio
          • (2) Inefficiencies in Rucio (and FTS)
            • See talk by Radu at FTS workshop in March
            • e.g. Why does Rucio/FTS use source X, while site X is very busy, why doesn't it chose source Y
            • Please share inefficiency examples!
            • More details next week
            • Martin will create issue to collect inefficiences
          • (3) Writing a control framework
            • Examples where operators might want more controls
            • Sorting algorithms, control flows?
            • Any wishes?
              • Martin will create issue to collect ideas
          • Send feedback to yang.r.yang@yale.edu
    • 15:25 15:55
      Developers roundtable 30m
      • 32 "The Good, The Bad and the Donkey" Priority followup
        • In Progress
          • Incorporate IAM-based testing for token workflows #6188 [Eraldo, Dimitrios]
            • Checking IAM repo for docker containers for IAM
          • Migrate Dashboard to Clean Architecture #w/158 [Mayank, Anton]
          • Internal transfer monitoring #6189 [Radu]
            • Refactor to a full graph view of the transfers
          • New dispatcher logic for conveyors #6190 [Radu]
            • Prototype quite compliacted (Relies on async python)
            • Need to assess if the complexity is worth the benefit
        • In Review
          • Migrate DID and DID-metadata view to clean architecture #w/160 [Mayank, Anton]
          • Migrate List My Rules and Rule View to clean architecture #w/159 [Mayank, Anton]
          • Create Pages for Create Rule Workflow #w/144 [Anton]
          • Unable to Delete File DID via Undertaker #5154 [Anton]
          • Adapt probes to rucio/rucio #5804 #p/108 [Eric]
            • CMS running 1.31 probes with this fix
            • Serious overhaul of probes needed (prometheus natively, for 33)
            • Needs ATLAS person to look at [Dimitrios]
              • Check with Eric about what parts need to be checked
        • Todo
          • Design and implement a token request module #6187 [Dimitrios]
          • Design and implement a token cache module #6183 [Dimitrios]
          • Support protocols with NULL priority #6201 [Dimitrios]
          • Kick off SIG-Tokens [Martin, Dimitrios]
          • Reduce core tickets <15 [Martin, Mario]
          • foreign key error on deleting dids in reaper #5733 [Martin]
          • Support OIDC login #w/149 [Mayank]
          • Exchange of function-based indices with normal index #6143 [Radu]
        • Done
        • Delayed
          • Update/Re-design core.meta module #5224 [Rob]
          • Document and cleanup discrepancies between surl and lfn2pfn algorithms #5129 [Martin]
          • Create a server/daemon installation howto #d/178 [Mayank]
          • Create developers testing guide in the documentation #d/177 [Mayank]
      • Documentation corner
        • Document environmental variables affecting the client #171 [Dimitrios]
        • Documentation and dev guidelines for MyPi type annotations #116 [Mayank, Martin]
        • Create developers testing guide in the documentation #177 [Mayank]
        • Create a server/daemon installation howto #178 [Mayank]
          • Ubuntu-specific PR #215
        • Improve documentation on rucio.cfg vs configuration table #183 [Radu]
        • Add an FAQ-style entry aimed at users for STUCK rules #184 [Fabio]
        • Add instruction about DB partitioning #185 [Martin]
        • bridge the gap between running rucio in demo env and full production deployment #187 [Radu]
        • Introduce documentation on subscriptions #190 [Cedric]
        • Page about the different event types and messages (ActiveMQ) #226 [Eraldo]
          • Collected all the information
          • Need to submit PR and wait for comments
      • Other topics
        •  
    • 15:55 16:00
      AOB 5m