BiLD-Dev

→ Europe/Zurich
2-R-014 (CERN)

2-R-014

CERN

Federico Stagni (Conseil Europeen Recherche Nucl. (CERN)-Unknown-Unknown)
Description
Bi-Weekly "Loyal" DIRAC developers meeting. And, following, the LHCbDIRAC developers meeting.

At CERN: Federico, Andre', Vladimir, Zoltan, Philippe, Joel, Stefan
On Vidyo: Ueda, Milosz

Apologies: Luisa, Wojtek, Andrei

 

Follow-up from previous meeting

  • Previous meeting was mostly dedicated to discussing 2 projects done by our student:
    • Move to logging
      • Works very well, already fully available from DIRAC v6r19
      • Also logs centralization looks like working OK (has to be seen in a production setup)
    • Move to JSON as serialization
      • a PR made, but broken. Developer left, we asked him to made it better

Current situation

DIRAC:

  • v6r17p31 is the last production version
  • v6r19-pre9 is out
    • Still problems with RSS
      • Fully re-implemented ResourceManagementDB (in a PR, should be reviewed and then merged straight away)
      • ResourceStatusDB should also be updated, but not for v6r19
    • Using externals v6r6p3 and lcgBundle v12r5
    • Today we'll make v6r19-pre10

WebApp:

  • NTR

Pilot:

  • We can introduce Pilot3 as optional from the SiteDirectors from next version

Externals:

  • v6r6p3 still the latest (for v6r19) for both SLC6 and CC7

LCG bundles:

  • New Version v12r8 compiled, it will be in testing with DIRAC v6r19 pre versions
    • CC7 version should be also OK, but librarians of GFAL2 won't make a statically compiled version, so it will need to use the local one.
    • We discourage its use for now

PyGSI:

  • NTR

Release planning, tests and certification

Release planning:

  • v6r17 series
    • NTR
  • v6r19 series
    • v6r19-pre10 will be created including PRs already reviewed OK
    • It should use lcgBundle v12r8 and it should work also on CC7

Certification process: 

  • One more certification hackhathon will be done tomorrow morning
    • Using trello and slack as usual

Weekly development(s) focus

  • Deployment of DIRAC tarballs and of lcgBundle tarballs
    • lcgBundle creation should be moved to github [Joel]
      • Simple list of packages (RPMs) included in a file
      • Instructions and deployment tools should be added to the git repo too
      • other VOs if they want they can extend the package too
    • deploy on CVMFS:
      • it's unclear who as of today governs the dirac.egi,eu. We anyway think that all DIRAC versions should be deployed there
        • as of now it's just another place where the DIRAC tarball is dumped
        • we should investigate how to deploy a full release there
      • lcgBundle should be also uploaded to CVMFS
    • Move out of AFS: 
      • process need to be started to move tarballs and cfg files outside of AFS
      • EOSWeb is the advised solution but now it doesn't seem to be yet at production quality
      • http://lhcbproject.web.cern.ch/lhcbproject/dist/DIRAC3/globalDefaults.cfg still used by dirac-install.
      • We can't simply move the website above to EOS, as of now it hosts several websites. So a new one, dedicated to DIRAC has to be made. 

DIRAC: current PRs and tasks being worked on

  • Some PRs need now to be reviewed and then we can prepare v6r19-pre10

AOB

  • Next BiLD-Dev meeting will be held in 2 weeks (September 28)

 

LHCbDIRAC

  • lb-run should always be called from an environment that is clean (saved within the pilot just after lbLogin)
    • This can be done even now [Federico]
  • Philippe: before having a non-lb-run installation of LHCbDIRAC we need to have an intermediate solution
  • Ganga should always call -c best
  • All tasks have been added to https://its.cern.ch/jira/browse/LBCORE-1410
There are minutes attached to this event. Show them.
    • 10:00 → 10:10
      Items from Previous BiLD-Dev 10m
    • 10:10 → 10:15
      Current situation 5m

      General remarks

    • 10:15 → 10:35
      Release planning, tests and certification 20m
      DIRAC certification
    • 10:35 → 10:55
      Weekly development(s) focus 20m
    • 10:55 → 11:05
      DIRAC: current PRs and tasks being worked on 10m

      Ongoing PRs
      - v6r19 PR
      Ongoing tasks
      - ?
      Topics from the google forum
      - ?

    • 11:05 → 11:15
      AOB
      Convener: Federico Stagni (CERN)
    • 11:15 → 11:30
      LHCbDIRAC 15m

      Today's topic will be deployment to CVMFS. Ben and Marco to present their ideas:

      • "conceptually" incompatible with physics software
      • breaking forced compatibility of lcgBundle with LHCbGrid
      • leave lcgBundle "only" for LHCbDIRAC, LHCbGrid to physics software
      • lb-run for LHCbDIRAC "death"?