Choose timezone
Your profile timezone:
BiLD-Dev
→
Europe/Zurich
2-R-014 (CERN)
2-R-014
CERN
Description
Bi-Weekly "Loyal" DIRAC developers meeting.
And, following, the LHCbDIRAC developers meeting.
At CERN: Federico, Zoltan, Christophe, Andre', Marko, Louis, Lara, Joel, Vladimir
On Vidyo: Xiaomei, Andrei, Yash
Apologies: Wojtek, Daniela, Simon
Follow-up from previous meeting
- DUW 2 weeks ago
- for next time:
- we may even account for more discussion
- we may possibly schedule beforehand some "private" discussion
- and maybe do a first day with ONLY introductions
- the introductory part was good for the tutorial
- we should send a mail or survey asking for feedback [Federico]
- for next time:
- Simon and Chris worked on a PR (#3713) for fixing the infamous "invalid action proposal" by speeding up the handshake and not looking up the user/group in the baseStub
- does the OSCompatibility section in CS need to be kept up-to-date? Not sure, to be checked.
Current situation
DIRAC
- v6r20 out
- also v6r20p1
- used in test from CLIC and GridPP
WebApp:
- one PR to be merged
- v4r0 looks "ready", won't depend from any specific DIRAC release
- compiled ExtJS6 can be distributed without licensing issues
- possibility to distribute ExtJS6 (compiled) to cvmfs? e.g. in dirac EGI
- anyone that has an extension need anyway to recompile, and so needs to have an account on Sencha
Pilot:
- Pilot3: PR adding stomp and rest and localFile message logger accepted in devel branch.
- Wijtech added a small PR that changes imports of stomp and requests to the class scope of Message Senders.
- The Jenkins test for local sender is ready and active.
- The next step will be to setup the ActiveMQ test on jenkins combined with corrections in DIRAC MQ components. After that, the REST rewriting and setup of "final" tests.
Externals:
- NTR
DIRACOS:
- pushed to https://github.com/DIRACGrid/DIRACOS the first version
- ready to be used, maybe already for v6r21
LCG bundles:
- v14r1 is right now the "official" bundle for DIRAC v6r20
- May need an update soon, possible bug discovered
- new versions of fts3, gfal2, xrootd should be included
- CC7 version does not include M2Crypto [to be fixed still]
REST:
- NTR
BOINC:
- NTR, docs still need to be completed
PyGSI:
- NTR
Documentation
- Several documentations updated
- Zoltan wants to further add to the accounting documentation
- At the DUW we agreed on putting more technical info in the docstrings of the DIRAC components
- Andrei will submit a PR to "set the tone (the format)" on how to write this technical documentation. The SiteDirector and the Matcher will be used as example.
DB12:
- NTR
Release planning, tests and certification
Release planning:
- v6r19 series
- NTR (just a patch coming)
- v6r20 series
- v6r20p2 will be created today
- v6r21 series
- we can start v6r21-pre1. The list of PRs that can go in:
- #3702 : removed unused/outdated stuff from Distribution module
- #3701 : Grouping loaders (should be advertised in the wiki in order to avoid surprises in the extensions)
- we can start v6r21-pre1. The list of PRs that can go in:
Certification process:
- v6r21 certification:
- will be started next week or the week after
Weekly development(s) focus
- dirac-install ++
- see attached presentation
- based on task #3517
- ongoing PR: #3678
- the only thing we agreed on was to write down the specific use case we have in the task above
- the only possible conclusion we have from today's discussion is that we want to installed software, released or not released, in a "composite" way. The source should be... whatever (git repo, local, remote, zip,...).
DIRAC: current PRs and tasks being worked on, or topics from Google forum
- PRs:
- #3703 on new production system: several comments, not for today (Luisa not present). Won't be merged, for now
- #3708 on using the ES for JobParameters
- have to be careful not to intersect with JobAttributes, which should not go ES
- at some point we will need to look into doing performance testing
- this PR can MAYBE be merged already
- Forum:
- North African Grid group wants to use DIRAC for *everything*
DIRAC communities roundtable
- BES:
- using singularity
- ILC:
- NTR
- LHCb:
- NTR
- EGI:
- Several things going on, NTR to this meeting
AOB
- Federico was listening to WLCG-DOMA
- seems like theory on what is a data lake is changing (now there are smaller lakes!)
- Rucio (going to be) installed in few places (RAL, BNL) for handling DM of local experiments
- DUNE being one of them
- Next BiLD-Dev meeting will be held in 2 weeks (June 21)
LHCbDIRAC
- Louis work is ongoing, a prototype will be at some point ready, it could possibly go as a DIRAC extension
- tornado not compatible with proxies yet -- due to an SSL "missing feature"
- Chris opened an issue on tornado github, for using M2Crypto
- at the end Chris will make the PR against tornado
- Lara just started: her work will be on producing statistics for MC jobs using elasticSearch
- v9r2 certification
- progressing, the last round was quite OK, but:
- not yet tested FTS3 (Chris will submit staging transformation)
- not yet installed on CVMFS
- need DIRAC v6r20p2 to continue
- progressing, the last round was quite OK, but:
There are minutes attached to this event.
Show them.