Choose timezone
Your profile timezone:
BiLD-Dev
→
Europe/Zurich
Description
Bi-Weekly "Loyal" DIRAC developers meeting. And, following, the LHCbDIRAC developers meeting.
Join Zoom Meeting
https://cern.zoom.us/j/91083694183?pwd=ZkdDY1I1YkJVc2o3UTdBY1BRZE15UT09
Meeting ID: 910 8369 4183
Passcode: 12345678
One tap mobile
+41432107108,,91083694183# Switzerland
+41315280988,,91083694183# Switzerland
Dial by your location
+41 43 210 71 08 Switzerland
+41 31 528 09 88 Switzerland
+41 43 210 70 42 Switzerland
+33 1 8699 5831 France
+33 1 7037 2246 France
+33 1 7037 9729 France
Meeting ID: 910 8369 4183
Find your local number: https://cern.zoom.us/u/artUfAdNB
Join by SIP
91083694183@188.184.89.188
91083694183@188.185.118.153
Join by H.323
188.184.89.188
188.185.118.153
Meeting ID: 910 8369 4183
Passcode: 12345678
BiLD (Bi-weekly DIRAC Development meeting) – 15/09/2022
On Zoom: Federico, Andrei, Alexey, Christophe, Daniela, Hideki, Simon, Xiaomei, Janusz, Ueda, Andre, Vladimir
Apologies: Igor
Follow-up from previous meetings
- Last BiLD on August 18th
- hackathon August 25th, on 8.0.0a29:
- Not done too much but anyway this was the last 8.0 hackathon
DIRAC communities roundtable
GridPP:
Daniela+Simon+Janusz
- Running v7r3p28
LHCb:
Federico+Christophe+Alexey
- Running (almost) latest v7.3.
- Ran an LHCbDIRAC hackathon using DIRAC 8.0 as base, looked OK
ILC/CLIC/FCC/Calice:
André
- NTR (still on v7r2)
EGI:
no-one
- NTR
Belle2
Hideki+Ueda
- v7r2 in production
- started certification for v7r3
- trying to create v7.3 py3 release. The JS is not embedded.
- Federico please write a github discussion
BES, Juno
Xiaomei
- Running v7r3 in production
- Discussion about Cloud on github very useful, now it is working
Topics from GitHub/Discussions or Google forum
only un-answered topics below:
- Histogram CPU time in Accounting
- unanswered
- Error running singularity containers
- only partially answered
- How to add a new Subsection to an existing part of the Configuration
- waiting for follow-up
- Expose rucio API via DIRAC (DMS/Client/RucioClient.py)
- unanswered
DIRAC releases
- v7r2:
- v7r2p49
- uses
suds(only affects py3 clients)
- uses
- v7r2p50:
- NEW: Experimental support for Python 3.10
- v7r2p49
- v7r3
- v7.3.28
- Resources
- FIX: (#6319) Forward jobDesc to innerCE in PoolCE
- FIX: (#6310) Set HOME in SingularityCE
- FIX: (#6303) Return proper error if provider value missing in CloudCE
- FrameworkSystem
- FIX: (#6305) Don’t notify users with expired proxies
- WorkloadManagement
- FIX: (#6304) Log error if CE Platform is missing.
- Resources
- v7.3.29
- Core
- CHANGE: (#6325) Set OpenSSL ciphers to “DEFAULT:@SECLEVEL=1”
- NEW: (#6325) Experimental support for Python 3.10
- NEW: (#6325) Suppress InsecureRequestWarning when using dirac-configure with HTTPS servers
- Resources
- FIX: (#6358) new directory creation specifies the permission in octal mode
- NEW: (#6352) Add a setGfalSetting decorator
- CHANGE: (#6352) add a 30s timeout for removal at RAL
- WorkloadManagementSystem
- FIX: (#6353) Stop instance from VirtualMachineMonitor
- NEW: (#6348) The default InputDataDirectory used by DownloadInputData can be overridden by setting /LocalSite/InputDataDirectory
- Core
- v7.3.28
- v8r0
- v8.0.0
DIRAC projects
DIRAC:
Issues by milestone:
- v7r2:
- just 1 was left open (moved to v7r3) – so now there are 0
- v7r3:
- Still 14 open issues
- Add possibility to specify a DIRACOS2 version in SystemAdministrator and Pilot.
- often requested
- v8.0:
- 13 open issues, not much new to report
- some of these issues will need to be re-assigned, and/or moved
- 13 open issues, not much new to report
- v8.1:
- NTR
Other issues:
- Queue specific XRSLExtraString?
- Cancellation of FTS3 job when request is cancelled?
- Christophe What has already been submitted is left there. Cancelling the request means just updating the status in the database. There are way too many corner cases to cover, otherwise.
- Simon how can we cancel them?
- Christophe I will check if can do something
PRs discussed:
- [Remote Pilot Logger to tornado]
- Testing in GridPP.
WebApp:
- No PRs open
- there are 7 open issues, some of them rather old
Pilot:
- feat: Enable remote pilot logging using HTTP interface to Tornado
- from previous meeting Q: should we change also the DIRAC logger? in order to use the ISO 8601 format and microseconds. If this is done, then all log messages will have the same format
- an issue should be created with this
- file backend for now, and it will be enough for running the tests. Different backends (e.g. ES) can be added later
- from previous meeting Q: should we change also the DIRAC logger? in order to use the ISO 8601 format and microseconds. If this is done, then all log messages will have the same format
DIRACOS2:
- NTR
Documentation:
- from previous meeting diracgrid.org still forwards to http://mardirac.in2p3.fr
OAuth2:
- from previous meeting Any news from issue WLCG and Token transition – reminders and requirements ?
- WLCG issed a timeline document: https://zenodo.org/record/7014668#.YyLag9JBwQ9 (this will indirectly affect everyone else here). What are other communities doing?
tornado/HTTPs
- NTR
management
- 3 issues left, are they still valid?
diraccfg
- from previous meeting Christopher Do we want to make a release that drops support for py2?
- yes
COMDIRAC
- Merge in DIRAC? https://github.com/DIRACGrid/DIRAC/discussions/6157
- from previous meeting Andrei This is a good idea to merge COMDIRAC but there are quite a number of subtle technical implications. Suggestion is to have a discussion among interested developers (Andrei, Andrii, Daniela, Simon) and come up with a proposal to be discussed at some future BiLD.
DB12
- New issue (wrote as reminder) Re-tune parameters for python 3.10
Rucio
Release planning, tests and certification
8.0 release
- Done!
Certification machines
- lbcertifdirac70 machine:
- NTR
- lbcertifdiracoauth machine:
- Federico I will update to 8.0
Next hackathon(s)
- from previous meeting Computing Element of each supported type should be configured (HTCondorCE, 2 ARCS (Alexandre), 2 Clouds (Daniela), SSH). Consider OAuth tests as well - what is needed as far as certification servers configuration is concerned.
AOB
Next hackathon: 29th Sep
Next BiLD: 06th Oct
LHCbDIRAC
- https://lhcb-auth.web.cern.ch/
- We need to have IaM as interface of VOMS (some code need to be developed here)
- For the actual operation we should see (up to Joel).
- LHCbDIRAC hackathon based on 8.0
- v10r4: deploy board in https://trello.com/b/kzUKdMts/deploy-v10r3
- MySQL updates to be scheduled
- Vladimir DataBase for VMDIRAC
- Federico will create
There are minutes attached to this event.
Show them.