BiLD-Dev

→ Europe/Zurich
2-R-014 (CERN)

2-R-014

CERN

Federico Stagni (Conseil Europeen Recherche Nucl. (CERN)-Unknown-Unknown)
Description
Bi-Weekly "Loyal" DIRAC developers meeting. And, following, the LHCbDIRAC developers meeting.

At CERN: Federico, Christophe, Philippe, Marko, Andre, Louis, Joel
On Vidyo: Andrei, Marcelo, Ueda, Wojtek, Hydeki, Simon, Daniela

Apologies: Luisa

 

Follow-up from previous meeting

  •  

Current situation

DIRAC

  • Just patches for v6r19

WebApp:

  • Security breach (unauthorized uploads from web portal) should fixed with version in certification
    • need a certificate right now 

Pilot:

  • Wojtek PR for pilot logging: slowly progressing
    • still want to add more complete integration tests for both REST and MQ cases, to be used together RESTDirac and our MQ components, so keeping the [WIP] flag for this moment.
  • Pilot3 will become optional for v6r20 SiteDirectors, using a flag [Federico working on PR right now]
    • Currently Pilot3 files are uploaded to the web portal
      • Needs to update the documentation for that

Externals:

  • v6r6p6 created. Used in v6r20, looks OK for now
    • only for SLC6 for now, so that certification can keep going
    • CentOS7 version is anyway needed

LCG bundles:

  • v14r0 and v14r1 created. In testing right now (all looks OK) 
    • Mostly for xroot and gfal2 versions
    • LFC support re-included
    • No changes wrt v13r0 and the CentOS 7 support
      • see wiki for more details
  • current production version is still v13r0
  • DIRACOS: created a first working version
    • which can be installed using a flag in dirac-install.py script
    • looks OK at first tests, but only for SLC6
      • support for CC7 need some tweaks, investigated right now
    • for the moment is LHCb-ish but can be easily adapted  
    • need to use Jenkins or other CI system

REST:

  • NTR  

BOINC:

  • NTR, docs still need to be completed

PyGSI:

  • NTR

Documentation

  • Louis going through the Dev documentation
    • some issues when using SLC6 (python 2.6 as default)
    • also unclear how to handle the certificates

DB12:

  • NTR

Release planning, tests and certification

Release planning:

  • v6r19 series
    • NTR
  • v6r20 series
    • preX out
    • contains all the new features, so now it's only about testing
    • the flag for enabling bulk submission transaction can be removed [Federico -> PR done] 
    • FTS -> FTS3: no way to move files, need draining
    • we enabled shortly the flag that tells us what JSON can't parse, and got lots of errors
      • need to see if really needed

Certification process: 

  • v6r20 certification: 
    • Using trello and slack as usual
    • Some updates as usual
    • We need to (re)start all tests with the new lcgBundle and External

Weekly development(s) focus

  • Glue2 support not in Bdii2CSAgent neither [Andre + Vladimir]
    • https://github.com/DIRACGrid/DIRAC/issues/3633
      • HTCondorCEs at CERN now not advertised anymore in Glue1 
    • Andre looked into in and found out Glue2 is supported in a different way everywhere
      • big confusion
      • the suggestion is to look to make it work, for the moment, on our side, ONLY for HTCondor CEs at CERN
  • ARC CEs (no progress)
    • still sites need to install patches for DIRAC to understand its content
    • glue2 support still not there, not sure if with that it would work [Vladimir to look into it]
    • [Raja + Andrei + Daniela] to look in details

DIRAC: current PRs and tasks being worked on, or topics from Google forum

  • LCD users want to use 255 CHARs for filenames in DFC
    • not a good idea
    • Maybe technically possible, not sure: Andre will look if it's possible

DIRAC communities roundtable

  • GridPP:
    • SKA want to use TransformationSystem
      • some technical issues (unclear ... sorry bad connection)
      • ILC installation has been doing this for long time... get in contact
  • BES: 
    • NTR
  • ILC:
    • see above
  • LHCb: 
    • MySQL 5.7 comes with new plans, some problem for certain queries being investigated by DBoD
      • have a new plan for certain queries, need to see if effective/OK - x-checking with DBoD support
  • DIRAC4EGI:
    • increasing users, need new version of VOMS2CSAgent
  • Belle2:
    • 1 PR to come?

AOB

  • New website to be for diracgrid.org: find it at fstagni.web.cern.ch
    • not a blog, just announcement
  • DUW agenda updated
    • one of the themes will be for how to handle productions
      • and hopefully coming out with a common plan
    • Ops hackathons should be better planned
      • last year was not so good
      • need to know what users want to do
  • Next BiLD-Dev meeting will be held in 2 weeks (April 19)

LHCbDIRAC

  • LHCbDIRAC v9r2: first prereleases done
    • only tested in Jenkins
    • not much time lately
  • at most 4 students this summer: proceeding
    • summer student project accepted
    • 2 GSoC projects: hopefully getting students (3 of them submitted a proposal)

 

There are minutes attached to this event. Show them.
    • 10:00 → 10:10
      Items from Previous BiLD-Dev 10m
    • 10:10 → 10:25
      Current situation 15m

      General remarks

      • DIRAC 3m
      • WebApp 2m
      • Pilot 2m
      • Externals 2m
      • lcgBundle 2m
      • Documentation 2m
      • pyGSI, Rest, DB12, BOINC 2m
    • 10:25 → 10:40
      Release planning, tests and certification 15m
    • 10:40 → 11:00
      Weekly development(s) focus 20m
    • 11:00 → 11:10
      DIRAC: current PRs and tasks being worked on 10m

      Ongoing PRs
      - v6r19 PR
      Ongoing tasks
      - ?
      Topics from the google forum
      - ?

    • 11:10 → 11:20
      DIRAC Communities roundtable 10m
    • 11:20 → 11:30
      AOB
      Convener: Federico Stagni (CERN)
    • 11:30 → 11:45
      LHCbDIRAC 15m