BiLD (Bi-weekly DIRAC Development meeting) – 17/12/2020

At CERN: Again, nobody :/
On Zoom: Federico, Alexandre, Andrei, Christophe, Christopher, Daniela, Hideki, Igor, Janusz, Marko, Simon

Apologies: Ueda

Follow-up from previous meeting

• Ran hackathon last week on v7r2-pre24:
  • indico + trello
  • Release created from the new structure with src/DIRAC
  • Main discussion arising was about using DIRAC SE or webdav
    • no upload, rather use just an agent?
    • no need for webdav (?)
    • too complicated setup
    • DIRAC issue https://github.com/DIRACGrid/DIRAC/issues/4697 was already there, Federico coding solution
  • added EnableActivityMonitoring option to REA (using MonitoringSystem)
    • not tested yet
  • https functionalities not yet tried out
• Problems when diracproject.web.cern.ch went down:
  • dirac-install to use list of locations? https://github.com/DIRACGrid/management/issues/10  Andrei
• Juno issues were related to using Externals instead of DIRACOS
• DIRACOS master branch was broken because SLC6 repos was archived
  •  Marko replaced the repo files (mock was pointing to old locations).
• After discussion for supporting setuptools, Chris created https://github.com/DIRACGrid/DIRAC/pull/4865
  • all discussions should go there

DIRAC communities roundtable

GridPP:

 Daniela

• NTR

CLIC:

• NTR

LHCb:

 Federico

• Still on v7r0, could not do proper hackathons as waiting for new v7r1 patch.
• Will deploy as “first” thing in 2021

EGI:

 Andrei

• Still at v7r0. CA refusing to provide certificates not in the egi.eu domain. Trying to negotiate solution, as this is not allowing to move to v7r1, because of M2Crypto being strict (2 different domains not allowed). Maybe moving to another CA.

France Grilles:

 Andrei

• Negotiation into allocating resources, in view of merging EGI.

Belle2:

 Hideki

• DIRACOS migration ongoing. Trying to finish by next week.

JINR

 Igor

• Not much load.
• Security management for FC
  • what to choose?
  • performance?
    •  Andrei shouldn’t be slower
  •  Andrei maybe some files won’t be available if you switch full security manager
  •  Christophe please check https://dirac.readthedocs.io/en/latest/AdministratorGuide/Systems/DataManagement/dfc.html
  • Some documentation should be added: https://github.com/DIRACGrid/DIRAC/issues/4654
  • I will change the option in CS and report for any issues

Juno, BES3:

• NTR

DIRAC releases

• v7r0p43:
  • FIX for RSS agents
• v7r1p23:
  • FIX Bdii2CSAgent: remove constant update of NumberOfProcessors parameter
  • MonitoringDB (ES): better, faster aggregations.
• v7r2-pre25:
  • Mostly fixes

DIRAC projects

DIRAC:

PRs

• [v7r1][WIP] docs: user manage, proxy manager for addressing https://github.com/DIRACGrid/DIRAC/issues/4702

  • some of the documentation requested is not for v7r1, rather for v7r3
  • Christophe should look again into it, maybe split task?

• setuptools support for python 3

  •  Christopher I would need to modify all the scripts, and after that it would become really bulky
  • before doing that, consider the review by Christophe
  • others should also review

Issues

• v7r0:

  • 1 HTCondor issue  Alexandre
  • dirac-proxy-init silent fallback to /etc/vomses
    • re-assigned to Marko

• v7r1:

  • Still some tasks in there, some are for documentation
    • proxyManagement documentation in PR
    • Push for adding DFC-related documentation: https://github.com/DIRACGrid/DIRAC/issues/4654

• v7r2:

  • mostly non-urgent ones
  • addressing https://github.com/DIRACGrid/DIRAC/issues/4697

• v7r3:

  • Not discussed

• dirac-proxy-init silent fallback to /etc/vomses

WebApp:

PRs

• NTR

Issues

• Remove desktop view? (issue https://github.com/DIRACGrid/WebAppDIRAC/issues/427)
  • desktop view is still the default in some installations
  • Belle2 should verify if they can switch to tabs view

Pilot3:

PRs

• set DIRACSYSCONFIG env variable to pilot.cfg
  • extensions tests can be added in Jenkins

Issues

• https://github.com/DIRACGrid/Pilot/issues/120 (Pilot3 adds “pilot.cfg” on to user argument list)
  • addressed by the PR above
  • tests from GridPP are not there

DIRACOS:

• Still issue with wheel of Rucio (Chris)
• DIRACOS releases?
  • v1r17 was re-created? (it was copied from master to run the hackathon)
  • No, waiting for the above (rucio), then will make v1r18
• BTW, found that pip 20.3 was somewhat broken

DIRACOS2:

• fts-rest almost ready for python3
• mostly waiting on the setuptools PR

VMDIRAC:

• Simon created and merged several PRs for:
  • tests
  • automation of tests
  • python3 code-compliant
• version v2r4p9 added to v7r1p23 and v7r2

Documentation:

• NNTR
•  Andrii Removed dirac-version, in favor of dirac-info. Can I?
  • please not in v7r1, possible in v7r2. Verify if invoked in shell files.

OAuth2:

• WIP

tornado/HTTPs

• new M2Crypto version, some changes in locations but DIRAC should be protected

management

• NTR

diraccfg

• NTR

other externals, including Rucio

• Waiting for changes on rucio side

Release planning, tests and certification

• Certification machine updated to be multi-VO (task: https://github.com/DIRACGrid/DIRAC/issues/4631)

  • NNTR

• Next hackathon

  • next year (7th Jan)

Weekly development(s) focus

• NTR

AOB and topics from Google forum

Next hackathon on January 7th: https://indico.cern.ch/event/986689/
Next BiLD on January 14th: https://indico.cern.ch/event/986690/

Season’s greetings!

LHCbDIRAC

• Decided to NOT to a hackathon on the last day of work.