Go to the Indico Home Page Oldest event Older event Up to category Newer event Newest event Printable version
 
Focus on:  Hide Contributions
  • Compact style
  • Indico style
  • Indico style - inline minutes
  • Indico style - numbered
  • Indico style - numbered + minutes
  • Indico Weeks View
    • Switch to the management area of this event
    Login

    BiLD-Dev

    → Europe/Zurich
    Federico Stagni (CERN)
    Description

    Bi-Weekly "Loyal" DIRAC developers meeting. And, following, the LHCbDIRAC developers meeting.

    Join Zoom Meeting
    https://cern.zoom.us/j/91083694183?pwd=ZkdDY1I1YkJVc2o3UTdBY1BRZE15UT09

    Meeting ID: 910 8369 4183
    Passcode: 12345678
    One tap mobile
    +41432107108,,91083694183# Switzerland
    +41315280988,,91083694183# Switzerland

    Dial by your location
            +41 43 210 71 08 Switzerland
            +41 31 528 09 88 Switzerland
            +41 43 210 70 42 Switzerland
            +33 1 8699 5831 France
            +33 1 7037 2246 France
            +33 1 7037 9729 France
    Meeting ID: 910 8369 4183
    Find your local number: https://cern.zoom.us/u/artUfAdNB

    Join by SIP
    91083694183@188.184.89.188
    91083694183@188.185.118.153

    Join by H.323
    188.184.89.188
    188.185.118.153
    Meeting ID: 910 8369 4183
    Passcode: 12345678

    working notes
    Hide

    BiLD (Bi-weekly DIRAC Development meeting) – 14/10/2021

    At CERN: Alexandre, Christophe, André, Vladimir (in our offices…)
    On Zoom: Federico, Andrei, Andrii, Daniela, Janusz, Raja, Simon, Xiaomei
    Apologies: Ueda for Belle2

    Follow-up from previous meetings

    • Using black: Applied everywhere from rel-v7r2 on
      • corollary (for this and for sweeping): stop accepting non-security-related PRs for rel-v7r1
    • Sweeping: Applied everywhere from rel-v7r2 on
      • A couple of post-fixes had to be applied
      • merging PRs for “upper” branches created by the diracgridbot once the original one is merged.
      • PR sweeper ported to https://github.com/DIRACGrid/pr-sweeper
      • Conflicts are being taken care by the developers
      • corollary: creating releases has been largely simplified. Documentation should get an update.
        • for v7r2 and v7r3 release notes are still created by hand
        • for 8.0 release notes are created automatically. Reviewers of PRs should take care of reviewing the notes too.
    •  Andrei New RFC/Discussion to replace ?
      • NTR
    • hackathon of 7th October, 8.0.0a1:
      • first hackathon on v8.0 pre-release
      • created using the new release procedure
      • main issues were encountered when creating and deploying the release, for the rest it was pretty smooth

    DIRAC communities roundtable

    GridPP:

     Daniela+Simon+Janusz

    ILC/CLIC/FCC:

     André

    • The bashrc issue reported by GridPP with setting X509 variables pointing to /etc also affecting us

    LHCb:

     Federico+Christophe+Alexandre

    • NTR

    EGI:

     Andrei

    • from previous meeting Tried HTTP service with a FormationFileCatalog. Found that the http URL is not taking a specific service and rather uses the service name as the same as the handler name
      •  Christophe please make an issue with that, it’s probably fixable.
    • running quite smoothly
    • bug in v7r2 for running non-extended Pilots, PR today

    BES:

     Xiaomei

    • Tried to install 7.3 for updating to python3. Tried with new install_site.sh, failing somehow

    Topics from GitHub/Discussions or Google forum

    • X509_VOMS_DIR/X509_VOMSES
      • discussion going on for some time, we need to reach a consensus and act
      •  André will create a PR with a possible solution
        • probably reversing the order in which VOMSES are taken - e.g. do not start from the host

    DIRAC releases

    • v7r2p30:
      • Core: FIX: (#5474) Always get voms-proxy-init from DIRACOS to avoid issues generating proxies on CentOS 8
      • and several other fixes…
    • 7.3.5:
      • NEW: (#5409) FTS3 tornado Handler
      • NEW: (#5409) ReqManager tornado Handler
    • 8.0.01:
      • nothing new, apart from the fact that we could create this release…

    DIRAC projects

    DIRAC:

    Issues by milestone:

    Other issues:

    • NTR

    PRs discussed:

    • [v7r2] Multi-node allocations: Embed executableFile in the srun Wrapper
      •  Andrei asking for a code simplifications: the bulk submission right now is only for SLURM
      •  Federico indeed it has a uselss complication for now, but I think the current implementation might prove useful in the future
      •  Alexandre I will try to push bulk submission through ARC and a parallel library.

    WebApp:

    • from previous meetings Problem with empty ComponentMonitoring data - to be checked
      • need to use the DIRAC service, not go directly to ElasticSearch
    • from previous meetings Started to make PRs to use BaseRequesthandler, for WebApp handlers
      •  Christophe more documentation is needed
    •  Federico PRs are merged without review, I think we should wait for that? E.g. https://github.com/DIRACGrid/WebAppDIRAC/pull/570/files
    • black and the pr-sweeper should be added also for WebApp, but better wait for Chris Burr to be back

    Pilot:

    DIRACOS:

    DIRACOS2:

    • from previous meetingfts-rest on py3?
      • fts3-rest is added
      • the “official” client will be worked “soon”
    • from previous meetings Still missing rucio
      • 2 issues on their github (1 is solved/closed)
    • from previous meeting few issue with gfal2 and gsoap, working to put in condaforge
      • soon it should be available

    Documentation:

    OAuth2:

    tornado/HTTPs

    • FTS3 and ReqManager http handlers added to 7.3.5
    • In 8.0 one of the main changes is in the base services. Andrii is working for having HTTP/REST DIRAC services that would accept both tokens and proxies (the focus is on tokens, also becuase NGINX does not accept proxies). This will be in 8.0
      • Still, users once per year will need to upload their proxies because not all resources behind will digest tokens (and also the DISET DIRAC services will need to accept them)

    management

    • NTR

    diraccfg

    • NTR

    COMDIRAC

    • NTR

    DB12

     Alexandre

    • from previous meetings Port to python3:
      • next is (i) merge the PR (ii) make the package (iii) use it in DIRAC (iv) apply the “fix” 1.16 - 1.19.

    other externals, including Rucio

    •  Janusz 2 PRs open against rucio, one will be useful for defining scope without a rucio config
      • this is an interim solution

    Release planning, tests and certification

    •  Andrei the last hackathon for 8.0 went pretty smoothly, what shall we say about a quick deployment?

      •  Federico there are some PRs almost ready, mostly from Andrii, what shall we do about them?
      •  Christophe the HTTP part has been largely refactored in the these PRs, the documentation should also been updated. I will point you to what should be updated.

    • Certification machines

      • lbcertifdirac70 machine:
        • NTR
      • lbcertifdiracoauth machine:
        •  Federico are there token-accepting test resources to try? to add to the setup there
          • 1 CE and one SE that accept tokens would be enough
          •  Raja yes, there are
          •  Andrei we would need 8.1 there
            • token manager (this is actually already in 8.0)
            • registry cache
            • ARC and HTCondor plugins should be updated
          •  Andrii maybe clouds
          • some “old” resources should anyway be kept, but these new ones are the reason for this setup to exist

    • Next hackathon(s)

      • next week

    AOB

    Next hackathon: on October 21st: https://indico.cern.ch/event/1087517
    Next BiLD on October 28th: https://indico.cern.ch/event/1087516/

    LHCbDIRAC

    • NTR
    There are minutes attached to this event. Show them.