Choose timezone
Your profile timezone:
BiLD-Dev
→
Europe/Zurich
2-R-014 (CERN)
2-R-014
CERN
Description
Bi-Weekly "Loyal" DIRAC developers meeting.
And, following, the LHCbDIRAC developers meeting.
At CERN: Federico, Christophe, Raja, Andre', Marko, Zoltan, Philippe, Joel
On Vidyo: Ueda, Milosz, Luisa, Xiaomei, Simon, Daniela, Andrew
Apologies:
Follow-up from previous meeting
- (from previous-previous meeting) Move to JSON as serialization
- a PR made, but broken. Developer left, we asked him to made it better, no answer
Current situation
DIRAC:
- v6r17p32 is the last production version
- v6r19-pre11 is out
- Should fix the problems with RSS
- Fully re-implemented also ResourceStatusDB\
- Using externals v6r6p3 and lcgBundle v13r0
- v6r19 should be out ASAP
- Should fix the problems with RSS
WebApp:
- Zoltan is working on how to ship, using dirac-distribution, the entire Web framework, which right now requires additional deployment steps
- Possibly using installation packages defined outside of WebAppDIRAC itself
- This is a necessary step before moving to ExtJS 6
Pilot:
- Need to modify the synchronizer to create (also) a tarball of the pilot files, which should be downloaded then by the pilot wrapper (not using wget which may not be on CC7)
- We can introduce Pilot3 as optional from the SiteDirectors from next version
Externals:
- v6r6p3 still the latest (for v6r19) for both SLC6 and CC7
LCG bundles:
- New Version v13r0 compiled, it will be in testing with DIRAC v6r19 pre versions
- CC7 version, contrary to what we hoped for long, will NOT be OK (see below)
- librarians of GFAL2 won't make a static build, so as of today we are stuck on using the system libraries.
- This version includes python packages like pyparsing and futures, which should be anyway in the externals. To verify
- Issues with arc with v12r8 to be verified for v13r0
- lcgBundle creation should be moved to github [Joel]
- Simple list of packages (RPMs) included in a file
- Instructions and deployment tools should be added to the git repo too
- Tests should be added to it too
- other VOs if they want they can extend the package too
BOINC:
- NTR, but in LHCb we are producing quite some documentation for its use
PyGSI:
- NTR
Release planning, tests and certification
Release planning:
- v6r17 series
- NTR
- v6r19 series
- Should be out ASAP
- We'll also create the rel-v6r19 branch just after
- Due to lcgBundle issues, we won't assure any working version for CC7
- Should be out ASAP
Certification process:
- Certification is ongoing: https://trello.com/b/XpFoYDM6/v6r19-pre12
- Using trello and slack as usual
Weekly development(s) focus
- move towards CC7:
- we can't certify anything right now
- (newer) versions of GFAL2 assume that system libraries are present
- e.g. boost, but we can't assure that
- things are working on SLC6, not on CC7
- the only real solution would be to do a static build (statically linking of libraries) of GFAL2 and possibly of other packages
- need to re-compile really everything
- apparently this is what CMS is doing already
- followed discussion on how to move forward. SFT is not willing to create static builds, so we are stuck with a "do it ourselves" solution, on which right now we don't want to progress
- Using our own python with a different encoding is making things worse, in this matter
- But at the same time we can't afford to use the system python, which might be 2.6 version
DIRAC: current PRs and tasks being worked on
- pyGSI -> M2Crypto
- Added proxy delegation
- Need proper testing, including interaction between different versions of DIRAC
- Somewhat connected: FTS3 library ships also M2Cripto library
AOB
- RFC proxies are not yet the default in v6r17, while there's no reason why they should not be
- Then we can remove old legacy code in future version
- TranformationDB on cluster (MariaDB galera cluster with 3 nodes)
- triple increase of auto-increment: to be verified
- How do users submit jobs?
- LHCb: Ganga, mostly
- Some users of GridPP also use ganga
- ILC: docs are provided to submit jobs directly via DIRAC
- Trying now parametric jobs
- BES3: some with Ganga
- Also trying our parametric jobs
- Belle2: directly via DIRAC, in extension we provide some script to facilitate their work
- CTA: directly DIRAC, docs provided
- Chris suggests to use ipython notebook
- Next BiLD-Dev meeting will be held in 2 weeks (October 12)
LHCbDIRAC
- All tasks for migration out of lb-run have been added to https://its.cern.ch/jira/browse/LBCORE-1410
- Few more points from today:
- lb-run should always be called from an environment that is clean (saved within the pilot just after lbLogin)
- Ganga should always call -c best
- We should remove X509 variables from the environment file that is created.
- Pilots should set CMTConfig for setting up DIRAC in a CC7 environment (this is urgent)
- We decided that for the moment we stop releasing for CC7 (from v9r0) until we have a working solution
- After that we should put lb-run -c best in the pilot (it should be tested if it works)
There are minutes attached to this event.
Show them.