Go to the Indico Home Page Oldest event Older event Up to category Newer event Newest event Printable version
 
Focus on:  Hide Contributions
  • Compact style
  • Indico style
  • Indico style - inline minutes
  • Indico style - numbered
  • Indico style - numbered + minutes
  • Indico Weeks View
    • Switch to the management area of this event
    Login

    BiLD-Dev

    → Europe/Zurich
    Federico Stagni (CERN)
    Description

    Bi-Weekly "Loyal" DIRAC developers meeting. And, following, the LHCbDIRAC developers meeting.

    Join Zoom Meeting
    https://cern.zoom.us/j/91083694183?pwd=ZkdDY1I1YkJVc2o3UTdBY1BRZE15UT09

    Meeting ID: 910 8369 4183
    Passcode: 12345678
    One tap mobile
    +41432107108,,91083694183# Switzerland
    +41315280988,,91083694183# Switzerland

    Dial by your location
            +41 43 210 71 08 Switzerland
            +41 31 528 09 88 Switzerland
            +41 43 210 70 42 Switzerland
            +33 1 8699 5831 France
            +33 1 7037 2246 France
            +33 1 7037 9729 France
    Meeting ID: 910 8369 4183
    Find your local number: https://cern.zoom.us/u/artUfAdNB

    Join by SIP
    91083694183@188.184.89.188
    91083694183@188.185.118.153

    Join by H.323
    188.184.89.188
    188.185.118.153
    Meeting ID: 910 8369 4183
    Passcode: 12345678

    working notes
    Hide
     
     

    BiLD (Bi-weekly DIRAC Development meeting) – 05/05/2022

    On Zoom: Federico, Alexandre, Christophe, Christopher, Ruben, Simon M, Daniela, Janusz, Simon, Hideki, Xiaomei, Alexey, Michel, Igor
    Apologies: Andrei

    Follow-up from previous meetings

    DIRAC communities roundtable

    GridPP:

    Daniela+Simon+Janusz

    • On pre-prod server tested newest version of DIRACOS2, looks OK

    LHCb:

    Federico+Christophe+Christopher+Alexandre+Ruben+SimonM+Alexey

    • NTR

    EGI:

    Andrei

    • n/a

    Belle2

    Hideki

    • v7r3 in the development environment. Succeded in creating v7r2 client in py3.
    • Production still on v7r1
    • Q: how to fix the DIRACOS2 version?
    • Q: how to discover which version is running 
      bash-4.2$ cat $DIRACOS/.diracos_version
DIRACOS2 2.21

    BES3+Juno

    Xiaomei

    NICA

    Igor

    • NTR

    Topics from GitHub/Discussions or Google forum

    DIRAC releases

    • v7r2:
      • No new release created, but we should, as few fixes were merged
    • v7.3:
      • No new release created, but we should – several fixes went in:
        • NEW: (#6038) add CloudComputingElement
        • NEW: (#6040) bitterly implement multihop
        • NEW: (#6015) BringOnline setting for FTS transfers can be SE dependant
    • 8.0.0a20:
      • CHANGE: (#5944) Divided ComponentMonitoring into AgentMonitoring and ServiceMonitoring
      • CHANGE: (#6002) Replaced the flags for monitoring with a new unified flag system

    DIRAC projects

    DIRAC:

    Issues by milestone:

    Other issues:

    PRs discussed:

    WebApp:

    Pilot:

    DIRACOS2:

    • Added celery.
    • Fixed versions, mostly HTCondor.

    Documentation:

    OAuth2:

    tornado/HTTPs

    • from previous meeting Andrii We can eventually have special classes in Configuration and BundleDelivery to pass binary data - to be discussed.
      • NTR

    management

    • NTR

    diraccfg

    • NTR

    COMDIRAC

    • NTR

    DB12

    • NTR

    Rucio

    • Mostly “finished”. Multi-VO support for extrating scopes in the making (not on our side).

    Developers’ report

    Simon Mazenoux

    Optimizers in WMS use Executors.

    Task Queue: producer - consumer pattern, “scalable”.
    Task Queue implementation is implemented in DIRAC as Executor framework. Used for transitioning jobs from Received to Checking to Waiting (but also Staging)

    Celery: distributed task queue, written in python. Highly adapted, highly scalable. Can be used to replace the Executor framework
    Can remove the executor dependency. Needs RabbitMQ.

    Positive feedback, seems doable. Already a PR in the making. It introduces RabbitMQ as dependency. Scalability should not be an issue.

    Release planning, tests and certification

    • 8.0 release

      • Currently missing:
        • a few critical issues, but for OAuthZ we don’t want to improve ATM
        • BLOB->TEXT everywhere (only 1 DB missing)
      • Target: 1 more hackathon.

    • Certification machines

      • lbcertifdirac70 machine:
        • NTR
      • lbcertifdiracoauth machine:
        • NTR

    • Next hackathon(s)

      • Still on lbcertifdirac70

    AOB

    Next hackathon on May 12th
    Next BiLD on May 19th

    from previous meeting DIRAC Workshop: next week!

    LHCbDIRAC

    • Alexey agreed to take care of LHCbDIRAC Bookkeeping.
      • developments and maintenance is expected. Program of work will be defined in the next weeks.
    • v10r3: deploy board in https://trello.com/b/kzUKdMts/deploy-v10r3
      • upgrade of dfc: Chistophe in contact with DBOD support. Wants to wait and see what happened to lbwms first
      • HTTPS services: some work is still needed for most of them.
    • LHCbDIRAC hackathon based on 8.0
      • pushed to third week of May
     
    There are minutes attached to this event. Show them.
      • 10:00 → 10:10
        Items from Previous BiLD-Dev 10m
      • 10:10 → 10:20
        DIRAC Communities roundtable 10m
      • 10:20 → 10:30
        DIRAC releases 10m
      • 10:30 → 10:55
        DIRAC projects 25m
        • DIRAC
        • WebApp
        • Pilot
        • DIRACOS
        • DIRACOS2
        • VMDIRAC
        • Documentation
        • OAuth2
        • tornado/HTTPs
        • other externals (include Rucio)
        DIRAC certification
      • 10:55 → 11:00
        Release planning, tests and certification 5m
        DIRAC PRs
        google forum
      • 11:00 → 11:15
        Weekly development(s) focus 15m
      • 11:15 → 11:25
        AOB
        Convener: Federico Stagni (CERN)
      • 11:25 → 11:40
        LHCbDIRAC 15m