Software TIM in Glasgow

Europe/London
Lecture Theatre 222 (University of Glasgow)

Lecture Theatre 222

University of Glasgow

School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQ
Description
This second ATLAS software technical interchange meeting (TIM) will follow on from the very successful Berkley TIM on November last year. We will look at ongoing framework developments, strategies for algorithm parallelism and progress in infrastructure modernisation. All of these discussions map out how our software will evolve in the next few years towards Run3. As before the meeting will be discussion-rich, rather the full of talks and also to have room for discussion of more radical solutions and possibly disruptive changes. We plan general plenary sessions for the first few days, followed by dedicated breakouts and hackathons later in the week.
Participants
    • 1
      Registration 220 (Kelvin Building)

      220

      Kelvin Building

    • Welcome Lecture Theatre 222

      Lecture Theatre 222

      University of Glasgow

      School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQ
      Convener: Graeme Stewart (University of Glasgow (GB))
    • Core Software and Framework: Re-entrant Algorithms and Incidents Lecture Theatre 222

      Lecture Theatre 222

      University of Glasgow

      School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQ
      Conveners: Scott Snyder (Brookhaven National Laboratory (US)), Vakho Tsulaia (Lawrence Berkeley National Lab. (US))
    • 10:30
      Coffee 220 (Kelvin Building)

      220

      Kelvin Building

    • Core Software and Framework: Conditions Lecture Theatre 222

      Lecture Theatre 222

      University of Glasgow

      School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQ
      Conveners: Scott Snyder (Brookhaven National Laboratory (US)), Vakho Tsulaia (Lawrence Berkeley National Lab. (US))
    • 12:30
      Lunch 220 (Kelvin Building)

      220

      Kelvin Building

    • Outside ATLAS Lecture Theatre 222

      Lecture Theatre 222

      University of Glasgow

      School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQ

      Contributions from other experiments and projects

      Conveners: Graeme Stewart (University of Glasgow (GB)), Walter Lampl (University of Arizona (US))
    • 15:30
      Tea 220 (Kelvin Building)

      220

      Kelvin Building

    • Core Software and Framework: Trigger and Event Views Lecture Theatre 222

      Lecture Theatre 222

      University of Glasgow

      School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQ
      Conveners: John Baines (STFC - Rutherford Appleton Lab. (GB)), Scott Snyder (Brookhaven National Laboratory (US)), Vakho Tsulaia (Lawrence Berkeley National Lab. (US))
      • 13
        Trigger implementation in athenaMT
        Speaker: Tomasz Bold (AGH Univ. of Science and Technology, Krakow)
      • 14
        Views and Scheduler
        Speaker: Benjamin Michael Wynne (University of Edinburgh (GB))
      • 15
        Next steps for Scheduler & Views: Discussion
      • 16
        Common Trigger & Offline Monitoring
        Speaker: Tomasz Bold (AGH Univ. of Science and Technology, Krakow)
      • 17
        Data access - IDC & views: Discussion
    • 18
      Registration 220

      220

      University of Glasgow

    • Algorithmic Code: Reconstruction Lecture Theatre 222

      Lecture Theatre 222

      University of Glasgow

      School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQ
      Conveners: Andreas Salzburger (CERN), Edward Moyse (University of Massachusetts (US))
      • 19
        Introduction

        Scope of this session
        Status & goals

        Speakers: Andreas Salzburger (CERN), Edward Moyse (University of Massachusetts (US))
      • 20
        Discussion
      • 21
        System Software Review Status

        What has been learned so far from the System Software Review

        Speaker: Graeme Stewart (University of Glasgow (GB))
      • 22
      • 23
        SW Evolution - Tracking: ACTS

        The tracking ACTS project & preparation for the future

        Speakers: Andreas Salzburger (CERN), Christian Gumpert (CERN)
      • 24
        Discussion
    • 10:30
      Coffee 220 (Kelvin Building)

      220

      Kelvin Building

    • Algorithmic Code: Reconstruction Lecture Theatre 222

      Lecture Theatre 222

      University of Glasgow

      School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQ
      Conveners: Andreas Salzburger (CERN), Edward Moyse (University of Massachusetts (US))
    • 12:30
      Lunch 220 (Kelvin Building)

      220

      Kelvin Building

    • Algorithmic Code: Simulation Lecture Theatre 222

      Lecture Theatre 222

      University of Glasgow

      School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQ
      Conveners: Andrew Haas (New York University), Zachary Louis Marshall (Lawrence Berkeley National Lab. (US))
    • 15:30
      Tea 220 (Kelvin Building)

      220

      Kelvin Building

    • Algorithmic Code: Simulation Lecture Theatre 222

      Lecture Theatre 222

      University of Glasgow

      School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQ
      Conveners: Andrew Haas (New York University), Zachary Louis Marshall (Lawrence Berkeley National Lab. (US))
      • 32
        Geant4 MT in ATLAS
        Speakers: Steven Andrew Farrell (University of California-Unknown-Unknown), Steven Andrew Farrell (Lawrence Berkeley National Lab. (US))
      • 33
        GeantV Possibilities
        Speakers: John Apostolakis (CERN), John Apostolakis (CERN)
      • 34
        Other Items

        Reproducibility issues, fast simulation in MT

        Speakers: Andrew Haas (New York University), Zachary Louis Marshall (Lawrence Berkeley National Lab. (US))
    • Tools and Infrastructure: Software Quality and Testing Lecture Theatre 222

      Lecture Theatre 222

      University of Glasgow

      School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQ
      Conveners: Shaun Roe (CERN), Stefan Kluth (Max-Planck-Institut fuer Physik (Werner-Heisenberg-Institut) (D)
      • 35
        Introduction and report
        Speaker: Shaun Roe (CERN)
      • 36
        Technical performance of ATLAS workflows
        Speaker: Antonio Limosani (University of Sydney (AU))
      • 37
        First Experiences with Google Mock Testing
        Speaker: Peter Sherwood (University College London (UK))
      • 38
        Testing in the Simulation Code
        Speaker: Elmar Ritsch (CERN)
      • 39
        Testing in Analysis Code
        Speaker: Nils Erik Krumnack (Iowa State University (US))
      • 40
        Guided Discussion: Summary and Planning
        Speaker: Stefan Kluth (Max-Planck-Institut fuer Physik (Werner-Heisenberg-Institut) (D)
    • 10:30
      Coffee 220 (Kelvin Building)

      220

      Kelvin Building

    • Tools and Infrastructure: Git and Jenkins Lecture Theatre 222

      Lecture Theatre 222

      University of Glasgow

      School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQ
      Conveners: Emil Obreshkov (University of Texas at Arlington (US)), Steve Lloyd (University of London (GB))
    • 12:30
      Lunch 220 (Kelvin Building)

      220

      Kelvin Building

    • 45
      Software Licensing Discussion Lecture Theatre 222

      Lecture Theatre 222

      University of Glasgow

      School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQ
      Speaker: Graeme Stewart (University of Glasgow (GB))
    • 46
      Hackathon - Algorithmic Migration 323

      323

      University of Glasgow

      Speakers: Charles Leggett (Lawrence Berkeley National Lab. (US)), John Baines (STFC - Rutherford Appleton Lab. (GB)), Scott Snyder (Brookhaven National Laboratory (US)), Vakho Tsulaia (Lawrence Berkeley National Lab. (US))

      this session will include discussions on:

      • migrating serial Algs to cloneable Algs
      • writing re-entrant Algs
      • sharing data between clones
        • explicit sharing vs merging at finalize
      • I also want some feedback on how we should deal with Histograms in cloned Algs
        • each clone gets its own hist? how to merge?
        • clones share a hist, and do locking themselves?
        • clones share a hist, and the THistSvc manages the locking?
      • PROPOSAL:
        • default behaviour of THistSvc is each clone gets it's own copy. histograms in clones are moved to memory resident. primary algorithm must explicitly call THistSvc->merge(id) during finalize to have cloned histograms merged into it
        • new method THistSvc::regSharedHist, which will create a shared instance of the Histogram for all clones
          • during execute, clients MUST lock histogram before manipulating it:
          • auto lockGuard = THistSvc->getLock(hist);
          • unlocked automatically when goes out of scope

       

      Tomasz: we have to sum more frequently online i.e. before every publication
      and TDAQ has implementation for it:
      https://svnweb.cern.ch/trac/atlastdaq/browser/DAQ/DataFlow/histmon/trunk/src/THistRegisterImpl.cxx#L288

       

       

    • 47
      Hackathon - Cyclomatic Complexity 220

      220

      University of Glasgow

      Speaker: Shaun Roe (CERN)
    • 15:30
      Tea 220 (Kelvin Building)

      220

      Kelvin Building

    • 48
      Hackathon - Algorithmic Migration 323

      323

      University of Glasgow

      Speakers: Charles Leggett (Lawrence Berkeley National Lab. (US)), John Baines (STFC - Rutherford Appleton Lab. (GB)), Scott Snyder (Brookhaven National Laboratory (US)), Vakho Tsulaia (Lawrence Berkeley National Lab. (US))

      This session could include:

      • CaloHive in athenaMT
      • Extend ID experience to migrate first Muon algo(s)
      • Implementation of Arrays of Handles / optional Handles
      • Can we manage without UpdateHandle? How to deal with collections that are not relevant to scheduling
      • Creation of IDC in views

      Notes:

      • Array of Handles: Agreed to add these (Charles)
      • UpdateHandles: Alternatives found for use cases discussed
        • Update common pattern in muons, simplest solution is copy.
        • PixelAmbiguitiesMap (axample showed by Adam) not needed.
      • Trigger use-case for offline data preparation: Add RegionSelectorSvc to InDet data preparation algorithms (trigger-specific configuration)
      • Scheduler & decoration: Use case: algo1->A->algo2->A*->algo3 Need solution to ensure algo3 is scheduled only after decoration (A*).  Need DecorateHandle that creates alias for decorated collection?  
    • 49
      Hackathon - Digitisation 424

      424

      University of Glasgow

      Speakers: John Derek Chapman (University of Cambridge (GB)), Zachary Louis Marshall (Lawrence Berkeley National Lab. (US))
    • 50
      Hackathon - Google Test 424

      424

      University of Glasgow

      Speaker: Stefan Kluth (Max-Planck-Institut fuer Physik (Werner-Heisenberg-Institut) (D)
    • 10:30
      Coffee 323 (Kelvin Building)

      323

      Kelvin Building

    • 12:30
      Lunch 323 (Kelvin Building)

      323

      Kelvin Building

    • 51
      Hackathon - ACTS 423

      423

      University of Glasgow

      Speakers: Andreas Salzburger (CERN), Christian Gumpert (CERN)
    • 52
      Hackathon - Conditions 323

      323

      University of Glasgow

      Speakers: Charles Leggett (Lawrence Berkeley National Lab. (US)), Scott Snyder (Brookhaven National Laboratory (US)), Vakho Tsulaia (Lawrence Berkeley National Lab. (US))
    • 53
      Hackathon - Google Test 423

      423

      University of Glasgow

      Speaker: Stefan Kluth (Max-Planck-Institut fuer Physik (Werner-Heisenberg-Institut) (D)
    • 54
      Hackathon - Trigger Demonstrator 323

      323

      University of Glasgow

      Speakers: John Baines (STFC - Rutherford Appleton Lab. (GB)), Simon George (Royal Holloway, University of London)
    • 15:30
      Tea 323 (Kelvin Building)

      323

      Kelvin Building

    • 18:30
      Dinner The Bothy

      The Bothy

      11 Ruthven LaneHillhead Glasgow West End G12 9BG
    • 55
      Hackathon - Job Configuration 423

      423

      University of Glasgow

      Speaker: Walter Lampl (University of Arizona (US))
    • 56
      Hackathon - Trigger Demonstrator 323

      323

      University of Glasgow

      Speakers: John Baines (STFC - Rutherford Appleton Lab. (GB)), Simon George (Royal Holloway, University of London)
    • 57
      Hackathon - git workflows 323

      323

      University of Glasgow

      Speakers: Edward Moyse (University of Massachusetts (US)), Elmar Ritsch (CERN), Emil Obreshkov (University of Texas at Arlington (US)), Frank Winklmeier (University of Oregon (US)), Goetz Gaycken (Universitaet Bonn (DE)), Graeme Stewart (University of Glasgow (GB))
    • 10:30
      Coffee 323 (Kelvin Building)

      323

      Kelvin Building

    • Wrap Up Lecture Theatre 257

      Lecture Theatre 257

      University of Glasgow

      Conveners: Graeme Stewart (University of Glasgow (GB)), Walter Lampl (University of Arizona (US))
    • 12:30
      Lunch 323 (Kelvin Building)

      323

      Kelvin Building