Focus on:  Hide Contributions
Login

Rucio Development Meeting

→ Europe/Zurich
4/S-030 (CERN)

4/S-030

CERN

30
Show room on map
Martin Barisits (CERN)
    • 15:00 → 15:10
      News 10m
    • 15:10 → 15:20
      News from the experiments 10m
      • ATLAS
        • Reprocessing campaign together with some other activities caused a lot of backlog in the Queues
          • Unfortunate since we couldn't test the tape carousel as well as we wanted
        • Limit size of datasets in the production system (50k limit)
      • ESCAPE
      • Belle II
        • General meeting in 10 days
        • Migration timescale will be proposed then
      • Brandon
        • Trying to get Ikarus integrated with Rucio
      • MultiVO 
        • No news for Multi-VO
      • James
        • No News
    • 15:20 → 15:30
      Hot topics 10m
      • GSOC projects
        • SWAN / Rucio integration
          • SWAN Extension to directly access Rucio data identifiers
          • Main Mentors: ESCAPE
          • Mentors: People from SWAN, Rucio, ESCAPE
        • FUSE Implementation
        • NLP Project (Tomas) 
      • CRIC Discussion 20m
        Speaker: Panos Paparrigopoulos (CERN)
        • CRIC discussion
          • RSEs and Transfer Matrix work - used like this in ESCAPE
          • Space reporting json
          • Keep the "scripts" in the probes repository
          • Separate probes for RSEs / Users / Distances
          • Dry run capability would be good; Capability to only run on a subset of RSEs would be good
          • Different permission to add new RSE and change protocol?
            • Yes it's possible
            • Create it, but only some people can enable it
          • Timeline for the probes changes
            • PR soon
          • Users script for ATLAS would not be used at the moment (still coming from VOMS) but this might be evaluated over the year
          • Probe should create the scope as well
            • Some VOs might not want to do that, could be a policy
          • Authentication methods
            • Import the ones set by CERN
              • X509 DNs
              • Plan for AAI: yes
          • Quotas
            • Would be useful to have the account-RSE quotas
            • Is tricky, since sometimes you want to set "programable quotas" e.g. 10%, if disk < 100TB, otherwies 5% ...
    • 15:30 → 15:55
      Developers roundtable 25m
      Rucio_Issue_burn_2020-01-23.png
      Rucio_priority_progress_2020-01-23.png
      • Issue burn update
      • Rucio 1.22 "Green Donkey" priority development followup
        • In Progress
          • Kubernetes [Thomas]
            • Still waiting for the new network controller
            • Jobber stuff not tested by Thomas, but for Eric it runs well
          • Reaper 2.0 #2412 [Cedric, Thomas]
            • It's essentially done, a few things need to be improved
            • Query to get list of unlocked replicas needs to be improved
          • OIDC #2612 [Jaroslav]
          • MultiVO #2635 [Ian, Andrew]
            • Further development when Eli starts
            • Need to consider Non-Multi-VO deployments with these changes
          • RSEMgr v2.0 #3147 [Tomas, Tobi]
            • Waiting on review & merge of one iteration
          • Unification of metadata #3096 [Aris]
            • Ongoing
          • General update of BB8 #3148 [Tomas, JJ, Dimitrios]
            • No news
            • Some comments on the PR would be helpful
            • Possibly a candidate to move to next Feature
        • ToDo
          • Data Pre-Placement [Thomas]
          • Documentation [Martin]
          • rucio.cfg vs config table #2630 [Mario]
          • Versioned history tables need explicit definition #2063 [Martin]
          • Protection of sources too strict in reaper #1637 [Cedric, Thomas]
          • Add file to content history in reaper #37 [Cedric, Thomas]
          • Reaper should stop in case of judge backlog #1578 [Martin]
          • Handling of Archives in Reaper #1431 [Cedric, Thomas, Mario, Martin]
          • Missing features for Archives #1091 [Mario, Martin]
          • Documentation page listing config table and RSE attributes #2631 [Mario]
          • Operators doc and repo #2636 [Martin]
        • Done
          • Repository cleanup #5252 [Martin, Thomas]
          • Configuration / Permissions / Policy #533 [James]
          • Cleanup of Issues [Everyone]
      • Auditor
        • Contacted by CMS who want to continue on Auditor work
        • Dimitrios and Thomas will try to give pointers, probably should re-write some parts of the auditor into an auditor2
      • Third party copy read and write needs to be enabled [Martin, Cedric]
        • Duplicate the information for both operations in the probe for now
    • 15:55 → 16:00
      AOB 5m
Powered by Indico v3.3.3-pre