Help us make Indico better by taking this survey! Aidez-nous à améliorer Indico en répondant à ce sondage !

Software TIM in Glasgow

Europe/London
Lecture Theatre 222 (University of Glasgow)

Lecture Theatre 222

University of Glasgow

School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQ
Description
This second ATLAS software technical interchange meeting (TIM) will follow on from the very successful Berkley TIM on November last year. We will look at ongoing framework developments, strategies for algorithm parallelism and progress in infrastructure modernisation. All of these discussions map out how our software will evolve in the next few years towards Run3. As before the meeting will be discussion-rich, rather the full of talks and also to have room for discussion of more radical solutions and possibly disruptive changes. We plan general plenary sessions for the first few days, followed by dedicated breakouts and hackathons later in the week.
Participants
  • Adam Edward Barton
  • Aidan Robson
  • Alexander Undrus
  • Andrea Helen Knue
  • Andreas Salzburger
  • Antonio Limosani
  • Attila Krasznahorkay
  • Axel Naumann
  • Benjamin Michael Wynne
  • Carlos Chavez Barajas
  • Charles Leggett
  • Christian Gumpert
  • David Lange
  • Dmitry Emeliyanov
  • Edward Moyse
  • Elmar Ritsch
  • Emil Obreshkov
  • Francesca Pastore
  • Frank Winklmeier
  • Goetz Gaycken
  • Graeme Stewart
  • Hadrien Benjamin Grasland
  • Iain Bertram
  • James Catmore
  • Johannes Elmsheuser
  • John Apostolakis
  • John Baines
  • John Derek Chapman
  • Joshua Wyatt Smith
  • Jovan Mitrevski
  • Marcin Nowak
  • Marco Cattaneo
  • Marco Clemencic
  • Mark Hodgkinson
  • Nicholas Styles
  • Nurcan Ozturk
  • Paolo Calafiura
  • Peter Sherwood
  • Ryan Mackenzie White
  • Sami Kama
  • Scott Snyder
  • Shaun Roe
  • Simon George
  • Stefan Kluth
  • Steven Farrell
  • Stewart Martin-Haugh
  • Torre Wenaus
  • Vakho Tsulaia
  • Valerie Flood
  • Walter Lampl
  • Will Buttinger
  • Zach Marshall
    • 08:30 09:00
      Registration 30m 220 (Kelvin Building)

      220

      Kelvin Building

    • 09:00 09:15
      Welcome Lecture Theatre 222

      Lecture Theatre 222

      University of Glasgow

      School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQ
      Convener: Graeme Stewart (University of Glasgow (GB))
    • 09:15 10:30
      Core Software and Framework: Re-entrant Algorithms and Incidents Lecture Theatre 222

      Lecture Theatre 222

      University of Glasgow

      School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQ
      Conveners: Scott Snyder (Brookhaven National Laboratory (US)), Vakho Tsulaia (Lawrence Berkeley National Lab. (US))
    • 10:30 11:00
      Coffee 30m 220 (Kelvin Building)

      220

      Kelvin Building

    • 11:00 12:30
      Core Software and Framework: Conditions Lecture Theatre 222

      Lecture Theatre 222

      University of Glasgow

      School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQ
      Conveners: Scott Snyder (Brookhaven National Laboratory (US)), Vakho Tsulaia (Lawrence Berkeley National Lab. (US))
    • 12:30 13:30
      Lunch 1h 220 (Kelvin Building)

      220

      Kelvin Building

    • 13:30 15:30
      Outside ATLAS Lecture Theatre 222

      Lecture Theatre 222

      University of Glasgow

      School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQ

      Contributions from other experiments and projects

      Conveners: Graeme Stewart (University of Glasgow (GB)), Walter Lampl (University of Arizona (US))
    • 15:30 16:00
      Tea 30m 220 (Kelvin Building)

      220

      Kelvin Building

    • 16:00 17:30
      Core Software and Framework: Trigger and Event Views Lecture Theatre 222

      Lecture Theatre 222

      University of Glasgow

      School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQ
      Conveners: John Baines (STFC - Rutherford Appleton Lab. (GB)), Scott Snyder (Brookhaven National Laboratory (US)), Vakho Tsulaia (Lawrence Berkeley National Lab. (US))
      • 16:00
        Trigger implementation in athenaMT 20m
        Speaker: Tomasz Bold (AGH Univ. of Science and Technology, Krakow)
      • 16:20
        Views and Scheduler 20m
        Speaker: Benjamin Michael Wynne (University of Edinburgh (GB))
      • 16:40
        Next steps for Scheduler & Views: Discussion 10m
      • 16:50
        Common Trigger & Offline Monitoring 20m
        Speaker: Tomasz Bold (AGH Univ. of Science and Technology, Krakow)
      • 17:10
        Data access - IDC & views: Discussion 20m
    • 08:30 09:00
      Registration 30m 220

      220

      University of Glasgow

    • 09:00 10:30
      Algorithmic Code: Reconstruction Lecture Theatre 222

      Lecture Theatre 222

      University of Glasgow

      School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQ
      Conveners: Andreas Salzburger (CERN), Edward Moyse (University of Massachusetts (US))
      • 09:00
        Introduction 5m

        Scope of this session
        Status & goals

        Speakers: Andreas Salzburger (CERN), Edward Moyse (University of Massachusetts (US))
      • 09:20
        Discussion 10m
      • 09:30
        System Software Review Status 15m

        What has been learned so far from the System Software Review

        Speaker: Graeme Stewart (University of Glasgow (GB))
      • 09:45
      • 09:55
        SW Evolution - Tracking: ACTS 20m

        The tracking ACTS project & preparation for the future

        Speakers: Andreas Salzburger (CERN), Christian Gumpert (CERN)
      • 10:15
        Discussion 15m
    • 10:30 11:00
      Coffee 30m 220 (Kelvin Building)

      220

      Kelvin Building

    • 11:00 12:30
      Algorithmic Code: Reconstruction Lecture Theatre 222

      Lecture Theatre 222

      University of Glasgow

      School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQ
      Conveners: Andreas Salzburger (CERN), Edward Moyse (University of Massachusetts (US))
    • 12:30 13:30
      Lunch 1h 220 (Kelvin Building)

      220

      Kelvin Building

    • 13:30 15:30
      Algorithmic Code: Simulation Lecture Theatre 222

      Lecture Theatre 222

      University of Glasgow

      School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQ
      Conveners: Andrew Haas (New York University), Zachary Louis Marshall (Lawrence Berkeley National Lab. (US))
    • 15:30 16:00
      Tea 30m 220 (Kelvin Building)

      220

      Kelvin Building

    • 16:00 17:30
      Algorithmic Code: Simulation Lecture Theatre 222

      Lecture Theatre 222

      University of Glasgow

      School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQ
      Conveners: Andrew Haas (New York University), Zachary Louis Marshall (Lawrence Berkeley National Lab. (US))
      • 16:00
        Geant4 MT in ATLAS 25m
        Speakers: Steven Andrew Farrell (University of California-Unknown-Unknown), Steven Andrew Farrell (Lawrence Berkeley National Lab. (US))
      • 16:40
        GeantV Possibilities 15m
        Speakers: John Apostolakis (CERN), John Apostolakis (CERN)
      • 17:05
        Other Items 15m

        Reproducibility issues, fast simulation in MT

        Speakers: Andrew Haas (New York University), Zachary Louis Marshall (Lawrence Berkeley National Lab. (US))
    • 09:00 10:30
      Tools and Infrastructure: Software Quality and Testing Lecture Theatre 222

      Lecture Theatre 222

      University of Glasgow

      School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQ
      Conveners: Shaun Roe (CERN), Stefan Kluth (Max-Planck-Institut fuer Physik (Werner-Heisenberg-Institut) (D)
      • 09:00
        Introduction and report 15m
        Speaker: Shaun Roe (CERN)
      • 09:15
        Technical performance of ATLAS workflows 15m
        Speaker: Antonio Limosani (University of Sydney (AU))
      • 09:30
        First Experiences with Google Mock Testing 15m
        Speaker: Peter Sherwood (University College London (UK))
      • 09:45
        Testing in the Simulation Code 15m
        Speaker: Elmar Ritsch (CERN)
      • 10:00
        Testing in Analysis Code 15m
        Speaker: Nils Erik Krumnack (Iowa State University (US))
      • 10:15
        Guided Discussion: Summary and Planning 15m
        Speaker: Stefan Kluth (Max-Planck-Institut fuer Physik (Werner-Heisenberg-Institut) (D)
    • 10:30 11:00
      Coffee 30m 220 (Kelvin Building)

      220

      Kelvin Building

    • 11:00 12:30
      Tools and Infrastructure: Git and Jenkins Lecture Theatre 222

      Lecture Theatre 222

      University of Glasgow

      School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQ
      Conveners: Emil Obreshkov (University of Texas at Arlington (US)), Steve Lloyd (University of London (GB))
    • 12:30 13:30
      Lunch 1h 220 (Kelvin Building)

      220

      Kelvin Building

    • 13:30 13:50
      Software Licensing Discussion 20m Lecture Theatre 222

      Lecture Theatre 222

      University of Glasgow

      School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQ
      Speaker: Graeme Stewart (University of Glasgow (GB))
    • 13:50 17:30
      Hackathon - Algorithmic Migration 3h 40m 323

      323

      University of Glasgow

      Speakers: Charles Leggett (Lawrence Berkeley National Lab. (US)), John Baines (STFC - Rutherford Appleton Lab. (GB)), Scott Snyder (Brookhaven National Laboratory (US)), Vakho Tsulaia (Lawrence Berkeley National Lab. (US))

      this session will include discussions on:

      • migrating serial Algs to cloneable Algs
      • writing re-entrant Algs
      • sharing data between clones
        • explicit sharing vs merging at finalize
      • I also want some feedback on how we should deal with Histograms in cloned Algs
        • each clone gets its own hist? how to merge?
        • clones share a hist, and do locking themselves?
        • clones share a hist, and the THistSvc manages the locking?
      • PROPOSAL:
        • default behaviour of THistSvc is each clone gets it's own copy. histograms in clones are moved to memory resident. primary algorithm must explicitly call THistSvc->merge(id) during finalize to have cloned histograms merged into it
        • new method THistSvc::regSharedHist, which will create a shared instance of the Histogram for all clones
          • during execute, clients MUST lock histogram before manipulating it:
          • auto lockGuard = THistSvc->getLock(hist);
          • unlocked automatically when goes out of scope

       

      Tomasz: we have to sum more frequently online i.e. before every publication
      and TDAQ has implementation for it:
      https://svnweb.cern.ch/trac/atlastdaq/browser/DAQ/DataFlow/histmon/trunk/src/THistRegisterImpl.cxx#L288

       

       

    • 13:50 17:30
      Hackathon - Cyclomatic Complexity 3h 40m 220

      220

      University of Glasgow

      Speaker: Shaun Roe (CERN)
    • 15:30 16:00
      Tea 30m 220 (Kelvin Building)

      220

      Kelvin Building

    • 09:00 12:30
      Hackathon - Algorithmic Migration 3h 30m 323

      323

      University of Glasgow

      Speakers: Charles Leggett (Lawrence Berkeley National Lab. (US)), John Baines (STFC - Rutherford Appleton Lab. (GB)), Scott Snyder (Brookhaven National Laboratory (US)), Vakho Tsulaia (Lawrence Berkeley National Lab. (US))

      This session could include:

      • CaloHive in athenaMT
      • Extend ID experience to migrate first Muon algo(s)
      • Implementation of Arrays of Handles / optional Handles
      • Can we manage without UpdateHandle? How to deal with collections that are not relevant to scheduling
      • Creation of IDC in views

      Notes:

      • Array of Handles: Agreed to add these (Charles)
      • UpdateHandles: Alternatives found for use cases discussed
        • Update common pattern in muons, simplest solution is copy.
        • PixelAmbiguitiesMap (axample showed by Adam) not needed.
      • Trigger use-case for offline data preparation: Add RegionSelectorSvc to InDet data preparation algorithms (trigger-specific configuration)
      • Scheduler & decoration: Use case: algo1->A->algo2->A*->algo3 Need solution to ensure algo3 is scheduled only after decoration (A*).  Need DecorateHandle that creates alias for decorated collection?  
    • 09:00 12:30
      Hackathon - Digitisation 3h 30m 424

      424

      University of Glasgow

      Speakers: John Derek Chapman (University of Cambridge (GB)), Zachary Louis Marshall (Lawrence Berkeley National Lab. (US))
    • 09:00 12:30
      Hackathon - Google Test 3h 30m 424

      424

      University of Glasgow

      Speaker: Stefan Kluth (Max-Planck-Institut fuer Physik (Werner-Heisenberg-Institut) (D)
    • 10:30 11:00
      Coffee 30m 323 (Kelvin Building)

      323

      Kelvin Building

    • 12:30 13:30
      Lunch 1h 323 (Kelvin Building)

      323

      Kelvin Building

    • 13:30 17:30
      Hackathon - ACTS 4h 423

      423

      University of Glasgow

      Speakers: Andreas Salzburger (CERN), Christian Gumpert (CERN)
    • 13:30 17:30
      Hackathon - Conditions 4h 323

      323

      University of Glasgow

      Speakers: Charles Leggett (Lawrence Berkeley National Lab. (US)), Scott Snyder (Brookhaven National Laboratory (US)), Vakho Tsulaia (Lawrence Berkeley National Lab. (US))
    • 13:30 17:30
      Hackathon - Google Test 4h 423

      423

      University of Glasgow

      Speaker: Stefan Kluth (Max-Planck-Institut fuer Physik (Werner-Heisenberg-Institut) (D)
    • 13:30 17:30
      Hackathon - Trigger Demonstrator 4h 323

      323

      University of Glasgow

      Speakers: John Baines (STFC - Rutherford Appleton Lab. (GB)), Simon George (Royal Holloway, University of London)
    • 15:30 16:00
      Tea 30m 323 (Kelvin Building)

      323

      Kelvin Building

    • 18:30 22:30
      Dinner 4h The Bothy

      The Bothy

      11 Ruthven LaneHillhead Glasgow West End G12 9BG
    • 09:00 12:00
      Hackathon - Job Configuration 3h 423

      423

      University of Glasgow

      Speaker: Walter Lampl (University of Arizona (US))
    • 09:00 12:00
      Hackathon - Trigger Demonstrator 3h 323

      323

      University of Glasgow

      Speakers: John Baines (STFC - Rutherford Appleton Lab. (GB)), Simon George (Royal Holloway, University of London)
    • 09:00 12:00
      Hackathon - git workflows 3h 323

      323

      University of Glasgow

      Speakers: Edward Moyse (University of Massachusetts (US)), Elmar Ritsch (CERN), Emil Obreshkov (University of Texas at Arlington (US)), Frank Winklmeier (University of Oregon (US)), Goetz Gaycken (Universitaet Bonn (DE)), Graeme Stewart (University of Glasgow (GB))
    • 10:30 11:00
      Coffee 30m 323 (Kelvin Building)

      323

      Kelvin Building

    • 12:00 12:30
      Wrap Up Lecture Theatre 257

      Lecture Theatre 257

      University of Glasgow

      Conveners: Graeme Stewart (University of Glasgow (GB)), Walter Lampl (University of Arizona (US))
      • 12:00
        Hackathon - Cyclomatic Complexity 2m
        Speaker: Shaun Roe (CERN)
      • 12:02
        Hackathon - Google Test 2m
        Speaker: Stefan Kluth (Max-Planck-Institut fuer Physik (Werner-Heisenberg-Institut) (D)
      • 12:04
        Hackathon - Digitisation 2m
        Speaker: John Derek Chapman (University of Cambridge (GB))
      • 12:06
        Hackathon - git workflows 2m
        Speaker: Edward Moyse (University of Massachusetts (US))
      • 12:08
        Hackathon - Algorithmic Migration 2m
        Speaker: Charles Leggett (Lawrence Berkeley National Lab. (US))
      • 12:10
        Hackathon - Conditions 2m
        Speaker: Charles Leggett (Lawrence Berkeley National Lab. (US))
      • 12:12
        Hackathon - ACTS 2m
        Speaker: Christian Gumpert (CERN)
      • 12:14
        Hackathon - Trigger Demonstrator 2m
        Speaker: John Baines (STFC - Rutherford Appleton Lab. (GB))
      • 12:16
        Hackathon - Configuration 2m
        Speaker: Walter Lampl (University of Arizona (US))
      • 12:18
        Closing Remarks 12m
        Speaker: Graeme Stewart (University of Glasgow (GB))
    • 12:30 13:30
      Lunch 1h 323 (Kelvin Building)

      323

      Kelvin Building