Rucio Development Meeting
-
- 15:00 → 15:10
-
15:10
→
15:20
News from the experiments 10m
- ATLAS
- Reprocessing campaign together with some other activities caused a lot of backlog in the Queues
- Unfortunate since we couldn't test the tape carousel as well as we wanted
- Limit size of datasets in the production system (50k limit)
- Reprocessing campaign together with some other activities caused a lot of backlog in the Queues
- ESCAPE
- Belle II
- General meeting in 10 days
- Migration timescale will be proposed then
- Brandon
- Trying to get Ikarus integrated with Rucio
- MultiVO
- No news for Multi-VO
- James
- No News
- ATLAS
-
15:20
→
15:30
Hot topics 10m
-
CRIC Discussion 20mSpeaker: Panos Paparrigopoulos (CERN)
- CRIC discussion
- RSEs and Transfer Matrix work - used like this in ESCAPE
- Space reporting json
- Keep the "scripts" in the probes repository
- Separate probes for RSEs / Users / Distances
- Dry run capability would be good; Capability to only run on a subset of RSEs would be good
- Different permission to add new RSE and change protocol?
- Yes it's possible
- Create it, but only some people can enable it
- Timeline for the probes changes
- PR soon
- Users script for ATLAS would not be used at the moment (still coming from VOMS) but this might be evaluated over the year
- Probe should create the scope as well
- Some VOs might not want to do that, could be a policy
- Authentication methods
- Import the ones set by CERN
- X509 DNs
- Plan for AAI: yes
- Import the ones set by CERN
- Quotas
- Would be useful to have the account-RSE quotas
- Is tricky, since sometimes you want to set "programable quotas" e.g. 10%, if disk < 100TB, otherwies 5% ...
- CRIC discussion
-
-
15:30
→
15:55
Developers roundtable 25m
- Issue burn update
- Rucio 1.22 "Green Donkey" priority development followup
- In Progress
- Kubernetes [Thomas]
- Still waiting for the new network controller
- Jobber stuff not tested by Thomas, but for Eric it runs well
- Reaper 2.0 #2412 [Cedric, Thomas]
- It's essentially done, a few things need to be improved
- Query to get list of unlocked replicas needs to be improved
- OIDC #2612 [Jaroslav]
- MultiVO #2635 [Ian, Andrew]
- Further development when Eli starts
- Need to consider Non-Multi-VO deployments with these changes
- RSEMgr v2.0 #3147 [Tomas, Tobi]
- Waiting on review & merge of one iteration
- Unification of metadata #3096 [Aris]
- Ongoing
- General update of BB8 #3148 [Tomas, JJ, Dimitrios]
- No news
- Some comments on the PR would be helpful
- Possibly a candidate to move to next Feature
- Kubernetes [Thomas]
- ToDo
- Data Pre-Placement [Thomas]
- Documentation [Martin]
- rucio.cfg vs config table #2630 [Mario]
- Versioned history tables need explicit definition #2063 [Martin]
- Protection of sources too strict in reaper #1637 [Cedric, Thomas]
- Add file to content history in reaper #37 [Cedric, Thomas]
- Reaper should stop in case of judge backlog #1578 [Martin]
- Handling of Archives in Reaper #1431 [Cedric, Thomas, Mario, Martin]
- Missing features for Archives #1091 [Mario, Martin]
- Documentation page listing config table and RSE attributes #2631 [Mario]
- Operators doc and repo #2636 [Martin]
- Done
- In Progress
- Auditor
- Contacted by CMS who want to continue on Auditor work
- Dimitrios and Thomas will try to give pointers, probably should re-write some parts of the auditor into an auditor2
- Third party copy read and write needs to be enabled [Martin, Cedric]
- Duplicate the information for both operations in the probe for now
-
15:55
→
16:00
AOB 5m