Choose timezone
Your profile timezone:
BiLD-Dev
→
Europe/Zurich
2-R-014 (CERN)
2-R-014
CERN
Description
Bi-Weekly "Loyal" DIRAC developers meeting.
And, following, the LHCbDIRAC developers meeting.
Bi-weekly DIRAC Development meeting -- 06/02/2020
At CERN: Federico, Zoltan, Christophe, Alexandre, Christopher, Andre', Marko
On Vidyo: Simon, Janusz, Andrei, Ueda
Apologies: Daniela
Follow-up from previous meeting
- The suggestion for the new "Completing" status originated one PR from Philippe (v7r1), ready for being merged.
- payload environment isolation
- Daniela: the problem is there, and we don't know how to solve it properly
- Federico: We need real use-case examples before looking at the code.
- Chris B: I can provide LHCb examples, I will start a forum or issue thread with them
- Igor and Andrei: examples can be provided also by us
DIRAC communities roundtable
- GridPP:
- VMDIRAC issues have been solved (see forum)
- Trying v7 in pre-production
- with v6r22 as pilot
- MultiVO DFC: got pressure to deliver
- Andrei talked privately with Janusz, a simpler solution has been discussed, will be tried by Janusz once back to work
- CLIC:
- Trying v7 in pre-production
- Started looking for using ElasticSearch
- asked question on version: what's supported in version 6
- LHCb:
- Hopefully not too far from a production version using v7, but encountered some GFAL2 issues
- BES3:
- NTR
- JINR:
- working fine, also included one HPC - WNs with internet, DB12 looks OK as benchmark, only single processor jobs
- France Grilles:
- v7 in production since October, but with Pilot 2 and no M2Crypto
- using it should be completely OK
- v7 in production since October, but with Pilot 2 and no M2Crypto
- EGI:
- v7r1-preX running in production for Check-IN interaction
- Issues with maintaining RESTDIRAC - using an old installation for that only. Asked question what to do -- HttpDIRAC won' come soon, if needed should be re-implemented using the WebApp
- Algerian group using DIRAC, adapting to DIRACOS
- Belle2
- WS in France, Andrei: no progress for DIRAC-Rucio
Current situation
DIRAC
- v6r22:
- NTR
- v7r0:
- v7r0p11 is the last one
- dirac-install can run on several python versions
- complementary with other ongoing PR on pilot wrapper running on several python versions
- for CentOS8
- dirac-install can run on several python versions
- v7r0p11 is the last one
- v7r1:
- last hackathon looked quite OK
- One more will be necessary next Thursday, maybe the last
- v7r2:
- NTR
VM:
- PR for passing the number of processors to the pilots, and filling mode
WebApp:
- NTR
Pilot3:
- PR https://github.com/DIRACGrid/Pilot/pull/100 targeting master with several things:
- moved from travis to github actions
- support for several python versions: 2.6.9, 2.7.5, 2.7.13, 3.6.8
- discovered that 2.6.9 was NOT supported
- 3.6.8 is supported from this PR on, but pending adaptation of dirac-install to python 3
- added shellcheck
- Another PR adds a nightly for uploading the master and devel version of Pilot to web server, for testing purposes
- test done together with https://github.com/DIRACGrid/DIRAC/pull/4392 (for pilot wrapper)
DIRACOS:
- new version v1r6 addressing https://github.com/DIRACGrid/DIRACOS/issues/112
- Singularity inside isn't fully self-contained, so basically not safe
- Agreed on removing Oracle dependency
Documentation
- One PR for release notes integration
OAuth2:
- Andrii working on pretty large PR. The whole work needs a proper intro and presentation. Will be discussed in a dedicated meeting, maybe next BiLD (20/02)
tornado and other externals
- JSON encoding PR is moving, being updated
- OpenSSL version: we are stuck with version 1.0, as 1.1 removed the possibility to specify an environment variable for RFC proxies. A PR has been created but not yet merged.
management
- PR for using dirac-distribution container for creating DIRAC extensions releases
cfg
- new repo: a pip-installable package for reading/managing DIRAC cfg files
Release planning, tests and certification
Release planning:
- v6r22 series
- just a few fixes (3 PRs)
- v7r0 series
- several PRs ready for being merged.
- v7r1 series
- A few fixes PRs, hefty ones (OAuth) not yet
- PR for "Completing" jobs' status ready
- Integration (and v7r2)
- Some PRs ready to be merged, waiting for Andrei
Certification process:
- Working PR for being able to run the integration tests (currently run regularly in Github actions) from DIRAC extensions
- being tested in LCHb (in GitLab CI)
- a proper doc+explanation will be needed, one tutorial will be done at the DIRAC workshop
- Github actions now used also by the WebApp
Weekly development(s) focus
- we can fully remove the support of Oracle from vanilla DIRAC
DIRAC: current PRs and tasks being worked on, or topics from Google forum
- v7r0:
- Mostly worries about environment separation (see above)
- Andrei: PR for escaping "," in CS, for specific use case of a user' DN
- comment: creates an ugly escaping, can we convinc the CA to not issue such DN?
- v7r1:
- Discussed above
- v7r2:
- NTR
AOB
Next week: DIRAC hackathon.
Next BiLD in 2 weeks.
There are minutes attached to this event.
Show them.