Choose timezone
Your profile timezone:
BiLD-Dev
→
Europe/Zurich
2-R-014 (CERN)
2-R-014
CERN
Description
Bi-Weekly "Loyal" DIRAC developers meeting.
And, following, the LHCbDIRAC developers meeting.
At CERN: Federico, Christophe, Andre', Louis, Stefan C.
On Vidyo: Xiaomei, Daniela, Simon, Marcelo, Yash, Hideki
Apologies: Ueda, Wojtiech
Follow-up from previous meeting
- gfal2 bug was fixed (it's not exactly in gfal2)
- we may not create a new lcgBundle with it.
- DIRACOS already includes the fixed version
Current situation
DIRAC
- v6r20p7 out
- multi-VO transformation system is now complete, also including TransformationCleaningAgent
- Some operation changes have to be better advertised in the wiki [Andre']
- fixing a bug for use of shifterProxy with TS agents (was introduced with v6r20p5)
- fixes to FTS3 kicking requests
- multi-VO transformation system is now complete, also including TransformationCleaningAgent
- v7r0-pre2 out
- not yet started the certification process
- Still missing few things, e.g. in dirac-install
WebApp:
- NTR
Pilot3:
- master branch up to date, including MultiProcessor fixes
Externals:
- NTR
DIRACOS:
- Will be used for v7r0
- needs some changes in dirac-install script to allow extensions of it (ongoing)
- Jenkins tests now all work
- Oracle still missing -- a bit peculiar
- need to try with latest python packages
- Size of the tarball: 300MB (1.2 GB when expanded)
- may be possibly compressed further
- maybe also remove also the documentation
- may be possibly compressed further
- requirements.txt file added - with instructions on how to update
- automatic build being setup in gitlabCI
LCG bundles:
- NTR
REST:
- NTR
BOINC:
- NTR, docs still need to be completed
PyGSI:
- NTR
Documentation
- Andre' used a `..literalinclude` magic for including in the agents' docstring what is in the ConfigTemplate.cfg files
- Everyone like the possibility to avoid duplicating info, so using the trick above is nice
- The ConfigTemplate.cfg of TransformationSystem now includes several comments. These would appear also in the CS when you hover over a specific option, which is nice
- Federico warns that we should always keep it in sync with the code -- the default values should be consistent
- Chris suggests to use the complete example of dirac.cfg from the code as authoritative source instead.
- decision on how to proceed is to be taken.
DB12:
- NTR
Release planning, tests and certification
Release planning:
- v6r20 series
- Few PRs ready to be merged
- Chris testing one for FTS3
- FTS3 multi-VO fixes also coming
- Few PRs ready to be merged
- v7r0 series
- the list of feature request is already closed
Certification process:
- v7r0 certification:
- to be started, but probably seriously only in few weeks
- https://jenkins-dirac.web.cern.ch/ is open to registrations for who needs it or wants it
- Federico showed a way how to use jenkins for testing ongoing developments [impoved]
Weekly development(s) focus
Python3:
- Stefan Chtiic presented the topic (see attachment)
- python-modernize is the tool to use
- suggestion that new code should be written in python 3, and then made it compatible with python 2
- need to pay attention at the use of iterators in python 3
- Several useful suggestions
- Need to draw a workplan: Federico will start a thread on how to proceed further
DIRAC: current PRs and tasks being worked on, or topics from Google forum
- Some PRs waiting for final review
DIRAC communities roundtable
- BES:
- moved to v6r20
- some issues with SiteDirector for non-LCG sites
- VMDIRAC seems not compatible anymore
- CLIC:
- NTR
- LHCb:
- Moved to v6r20 yesterday
- So far almost everything is OK, but fewer pilots submitted, being investigated.
- Belle2:
- NTR
- GridPP:
-
Running v6r20 in production. So far no problems, but some users had to update their UIs due to them using parametric jobs (error was "unconfirmed bulk submission" ) or something in this vein. Ran a test using FTS3, the multi VO pull request will be submitted today. We will try and setup a truly multiVO transformations system (at the moment we have one VO (SKA) on a multi VO server) between now and the next meeting.
-
AOB
- Next DIRAC Users Workshop: Daniela is trying to secure a room to potentially hold the next DIRAC Users Workshop in London. Possible dates: weeks of 13 and 20 of May 2019
- Next BiLD-Dev meeting will be held in 2 weeks (August 16)
LHCbDIRAC
- v9r2 deployed yesterday
- v9r3 plan:
- soon
- include:
- Lara's developments on use of ES for MC stuff
- switch on the bulk submission from WorkflowTaskAgent
- Pilot3 from SD
There are minutes attached to this event.
Show them.