Rucio Meeting
→
Europe/Zurich
Martin Barisits
(CERN)
-
-
15:00
→
15:05
News 5m
- Very positive Rucio mentions at CHEP
- DIRAC & Rucio workshop registration open!
- Rucio website hosting being migrated
- Might lead to some short unavailability
-
15:05
→
15:25
Community News & DevOps roundtable 20m
- ATLAS
- CMS
- Lost replicas
- When a replica is lost (last replica of a file is gone) Rucio detaches file from DS
- Make this behaviour optional
- Needs to be checked if this has an impact to other parts of the code
- Rules (and derived rule states, length of datasets vs rule locks counts, etc.)
- Locks
- Messages
- Should be tried out first; Adressed by test-cases
- When a replica is lost (last replica of a file is gone) Rucio detaches file from DS
- Process to upgrade to 1.31
- Multihop processing in 1.31 completely in Rucio, not FTS
- In ATLAS only done for some RSEs, not for all
- Multihop processing in 1.31 completely in Rucio, not FTS
- Finished extraction of consistency checking into separate repositories
- and pypi project
- CMS code is now using the rucio/consistency-checking package
- Documented under rucio/consistency-checking
- Please send comments!
- Lost replicas
- Fermilab DUNE / ICARUS / RUBIN
- Activated temporary table queries -> noticable performance improvement!
- list_replicas (with and without temp tables) showed significant improvements
- temp tables another factor 2
- All on postgres
- 1.29.12 was used
- list_replicas (with and without temp tables) showed significant improvements
- Another Rucio deployment for "mu2e"
- Lots of work on subscriptions and automatix (for automatic testing)
- Activated temporary table queries -> noticable performance improvement!
- Belle II
- ESCAPE
- Rebuilding new cluster in 1.30
- Some problems with cs3s protocol
- No documentation
-
15:25
→
15:55
Developers roundtable 30m
- 32 "The Good, The Bad and the Donkey" Priority followup
- In Progress
- In Review
- Todo
- Design and implement a token request module #6187 [Dimitrios]
- Incorporate IAM-based testing for token workflows #6188 [Dimitrios]
- Design and implement a token cache module #6183 [Dimitrios]
- Support protocols with NULL priority #6201 [Dimitrios]
- Kick off SIG-Tokens [Martin]
- Document and cleanup discrepancies between surl and lfn2pfn algorithms #5129 [Martin]
- Reduce core tickets <15 [Martin, Mario]
- foreign key error on deleting dids in reaper #5733 [Martin]
- Create a server/daemon installation howto #d/178 [Mayank]
- Create developers testing guide in the documentation #d/177 [Mayank]
- Support OIDC login #w/149 [Mayank]
- Migrate Dashboard to Clean Architecture #w/158 [Mayank, Anton]
- Exchange of function-based indices with normal index #6143 [Radu]
- Update/Re-design core.meta module #5224 [Rob]
- Done
- Replace all instances of X509 identities presented in the legacy format #6182 [Dimitrios]
- One PR still open for the documentation
- Replace all instances of X509 identities presented in the legacy format #6182 [Dimitrios]
- Delayed
- Documentation corner
- Document environmental variables affecting the client #171 [Dimitrios]
- Documentation and dev guidelines for MyPi type annotations #116 [Mayank, Martin]
- Create developers testing guide in the documentation #177 [Mayank]
- Create a server/daemon installation howto #178 [Mayank]
- Ubuntu-specific PR #215
- Improve documentation on rucio.cfg vs configuration table #183 [Radu]
- Add an FAQ-style entry aimed at users for STUCK rules #184 [Fabio]
- Add instruction about DB partitioning #185 [Martin]
- bridge the gap between running rucio in demo env and full production deployment #187 [Radu]
- Introduce documentation on subscriptions #190 [Cedric]
- Page about the different event types and messages (ActiveMQ) #226 [???]
- Other topics
- 32 "The Good, The Bad and the Donkey" Priority followup
-
15:55
→
16:00
AOB 5m
-
15:00
→
15:05