Software TIM in Glasgow
→
Europe/London
Lecture Theatre 222 (University of Glasgow)
Lecture Theatre 222
University of Glasgow
School of Physics & Astronomy
Kelvin Building
University of Glasgow
Glasgow G12 8QQ
Description
This second ATLAS software technical interchange meeting (TIM) will follow on from the very successful Berkley TIM on November last year. We will look at ongoing framework developments, strategies for algorithm parallelism and progress in infrastructure modernisation. All of these discussions map out how our software will evolve in the next few years towards Run3.
As before the meeting will be discussion-rich, rather the full of talks and also to have room for discussion of more radical solutions and possibly disruptive changes.
We plan general plenary sessions for the first few days, followed by dedicated breakouts and hackathons later in the week.
Support
Participants
-
-
08:30
→
09:00
Registration 30m 220 (Kelvin Building)
220
Kelvin Building
-
09:00
→
09:15
Welcome Lecture Theatre 222
Lecture Theatre 222
University of Glasgow
School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQConvener: Graeme Stewart (University of Glasgow (GB))- 09:00
-
09:07
Workshop Goals 7mSpeaker: Walter Lampl (University of Arizona (US))
-
09:15
→
10:30
Core Software and Framework: Re-entrant Algorithms and Incidents Lecture Theatre 222
Lecture Theatre 222
University of Glasgow
School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQConveners: Scott Snyder (Brookhaven National Laboratory (US)), Vakho Tsulaia (Lawrence Berkeley National Lab. (US))-
09:15
Reentrant Algorithms 45mSpeakers: Charles Leggett (Lawrence Berkeley National Lab. (US)), Scott Snyder (Brookhaven National Laboratory (US))
-
10:00
Incidents 30mSpeaker: Sami Kama (Southern Methodist University (US))
-
09:15
-
10:30
→
11:00
Coffee 30m 220 (Kelvin Building)
220
Kelvin Building
-
11:00
→
12:30
Core Software and Framework: Conditions Lecture Theatre 222
Lecture Theatre 222
University of Glasgow
School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQConveners: Scott Snyder (Brookhaven National Laboratory (US)), Vakho Tsulaia (Lawrence Berkeley National Lab. (US))-
11:00
Conditions data access in MT 30mSpeaker: Charles Leggett (Lawrence Berkeley National Lab. (US))
-
11:30
Experience with migration of conditions clients 30mSpeakers: Jovan Mitrevski (Ludwig-Maximilians-Univ. Muenchen (DE)), Vakho Tsulaia (Lawrence Berkeley National Lab. (US))
-
12:00
Handling of alignments in AthenaMT 20mSpeaker: Vakho Tsulaia (Lawrence Berkeley National Lab. (US))
-
11:00
-
12:30
→
13:30
Lunch 1h 220 (Kelvin Building)
220
Kelvin Building
-
13:30
→
15:30
Outside ATLAS Lecture Theatre 222
Lecture Theatre 222
University of Glasgow
School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQContributions from other experiments and projects
Conveners: Graeme Stewart (University of Glasgow (GB)), Walter Lampl (University of Arizona (US))- 13:30
- 14:05
-
14:40
CMS - Software Evolution 35mSpeaker: David Lange (Princeton University (US))
-
15:15
Bonus Discussion 15m
-
15:30
→
16:00
Tea 30m 220 (Kelvin Building)
220
Kelvin Building
-
16:00
→
17:30
Core Software and Framework: Trigger and Event Views Lecture Theatre 222
Lecture Theatre 222
University of Glasgow
School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQConveners: John Baines (STFC - Rutherford Appleton Lab. (GB)), Scott Snyder (Brookhaven National Laboratory (US)), Vakho Tsulaia (Lawrence Berkeley National Lab. (US))-
16:00
Trigger implementation in athenaMT 20mSpeaker: Tomasz Bold (AGH Univ. of Science and Technology, Krakow)
-
16:20
Views and Scheduler 20mSpeaker: Benjamin Michael Wynne (University of Edinburgh (GB))
-
16:40
Next steps for Scheduler & Views: Discussion 10m
-
16:50
Common Trigger & Offline Monitoring 20mSpeaker: Tomasz Bold (AGH Univ. of Science and Technology, Krakow)
-
17:10
Data access - IDC & views: Discussion 20m
-
16:00
-
08:30
→
09:00
-
-
08:30
→
09:00
Registration 30m 220
220
University of Glasgow
-
09:00
→
10:30
Algorithmic Code: Reconstruction Lecture Theatre 222
Lecture Theatre 222
University of Glasgow
School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQConveners: Andreas Salzburger (CERN), Edward Moyse (University of Massachusetts (US))-
09:00
Introduction 5m
Scope of this session
Status & goalsSpeakers: Andreas Salzburger (CERN), Edward Moyse (University of Massachusetts (US)) -
09:20
Discussion 10m
-
09:30
System Software Review Status 15m
What has been learned so far from the System Software Review
Speaker: Graeme Stewart (University of Glasgow (GB)) -
09:45
Discussion 10m
-
09:55
SW Evolution - Tracking: ACTS 20m
The tracking ACTS project & preparation for the future
Speakers: Andreas Salzburger (CERN), Christian Gumpert (CERN) -
10:15
Discussion 15m
-
09:00
-
10:30
→
11:00
Coffee 30m 220 (Kelvin Building)
220
Kelvin Building
-
11:00
→
12:30
Algorithmic Code: Reconstruction Lecture Theatre 222
Lecture Theatre 222
University of Glasgow
School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQConveners: Andreas Salzburger (CERN), Edward Moyse (University of Massachusetts (US))-
11:00
SW Evolution: Experience migrating ID algorithms to AthenaMT 25mSpeaker: Adam Edward Barton (Lancaster University (GB))
-
11:25
Discussion 15m
-
11:40
SW Evolution: Configuration 20mSpeaker: Walter Lampl (University of Arizona (US))
-
12:00
Discussion 10m
-
11:00
-
12:30
→
13:30
Lunch 1h 220 (Kelvin Building)
220
Kelvin Building
-
13:30
→
15:30
Algorithmic Code: Simulation Lecture Theatre 222
Lecture Theatre 222
University of Glasgow
School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQConveners: Andrew Haas (New York University), Zachary Louis Marshall (Lawrence Berkeley National Lab. (US))-
13:30
ARM & CMake: Porting to Other Platforms 20mSpeaker: Joshua Wyatt Smith (Georg-August-Universitaet Goettingen (DE))
-
14:00
Digitization and MT 40mSpeakers: Iain Bertram (Lancaster University (GB)), John Derek Chapman (University of Cambridge (GB))
-
14:55
Geant4 Plans 20mSpeakers: John Apostolakis (CERN), John Apostolakis (CERN)
-
13:30
-
15:30
→
16:00
Tea 30m 220 (Kelvin Building)
220
Kelvin Building
-
16:00
→
17:30
Algorithmic Code: Simulation Lecture Theatre 222
Lecture Theatre 222
University of Glasgow
School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQConveners: Andrew Haas (New York University), Zachary Louis Marshall (Lawrence Berkeley National Lab. (US))-
16:00
Geant4 MT in ATLAS 25mSpeakers: Steven Andrew Farrell (University of California-Unknown-Unknown), Steven Andrew Farrell (Lawrence Berkeley National Lab. (US))
-
16:40
GeantV Possibilities 15mSpeakers: John Apostolakis (CERN), John Apostolakis (CERN)
-
17:05
Other Items 15m
Reproducibility issues, fast simulation in MT
Speakers: Andrew Haas (New York University), Zachary Louis Marshall (Lawrence Berkeley National Lab. (US))
-
16:00
-
08:30
→
09:00
-
-
09:00
→
10:30
Tools and Infrastructure: Software Quality and Testing Lecture Theatre 222
Lecture Theatre 222
University of Glasgow
School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQConveners: Shaun Roe (CERN), Stefan Kluth (Max-Planck-Institut fuer Physik (Werner-Heisenberg-Institut) (D)- 09:00
-
09:15
Technical performance of ATLAS workflows 15mSpeaker: Antonio Limosani (University of Sydney (AU))
-
09:30
First Experiences with Google Mock Testing 15mSpeaker: Peter Sherwood (University College London (UK))
- 09:45
-
10:00
Testing in Analysis Code 15mSpeaker: Nils Erik Krumnack (Iowa State University (US))
-
10:15
Guided Discussion: Summary and Planning 15mSpeaker: Stefan Kluth (Max-Planck-Institut fuer Physik (Werner-Heisenberg-Institut) (D)
-
10:30
→
11:00
Coffee 30m 220 (Kelvin Building)
220
Kelvin Building
-
11:00
→
12:30
Tools and Infrastructure: Git and Jenkins Lecture Theatre 222
Lecture Theatre 222
University of Glasgow
School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQConveners: Emil Obreshkov (University of Texas at Arlington (US)), Steve Lloyd (University of London (GB))-
11:00
Moving towards Continuous Integration 20mSpeaker: Alexander Undrus (Brookhaven National Laboratory (US))
-
11:20
Making best use of CMake 20mSpeaker: Attila Krasznahorkay (CERN)
-
11:40
GIT workflow for ATLAS offline 20mSpeaker: Edward Moyse (University of Massachusetts (US))
-
12:00
GitLab and git workflows: experience from the ACTS project 20mSpeaker: Christian Gumpert (CERN)
-
11:00
-
12:30
→
13:30
Lunch 1h 220 (Kelvin Building)
220
Kelvin Building
-
13:30
→
13:50
Software Licensing Discussion 20m Lecture Theatre 222
Lecture Theatre 222
University of Glasgow
School of Physics & Astronomy Kelvin Building University of Glasgow Glasgow G12 8QQSpeaker: Graeme Stewart (University of Glasgow (GB)) -
13:50
→
17:30
Hackathon - Algorithmic Migration 3h 40m 323
323
University of Glasgow
Speakers: Charles Leggett (Lawrence Berkeley National Lab. (US)), John Baines (STFC - Rutherford Appleton Lab. (GB)), Scott Snyder (Brookhaven National Laboratory (US)), Vakho Tsulaia (Lawrence Berkeley National Lab. (US))this session will include discussions on:
- migrating serial Algs to cloneable Algs
- writing re-entrant Algs
- sharing data between clones
- explicit sharing vs merging at finalize
- I also want some feedback on how we should deal with Histograms in cloned Algs
- each clone gets its own hist? how to merge?
- clones share a hist, and do locking themselves?
- clones share a hist, and the THistSvc manages the locking?
- PROPOSAL:
- default behaviour of THistSvc is each clone gets it's own copy. histograms in clones are moved to memory resident. primary algorithm must explicitly call THistSvc->merge(id) during finalize to have cloned histograms merged into it
- new method THistSvc::regSharedHist, which will create a shared instance of the Histogram for all clones
- during execute, clients MUST lock histogram before manipulating it:
- auto lockGuard = THistSvc->getLock(hist);
- unlocked automatically when goes out of scope
Tomasz: we have to sum more frequently online i.e. before every publication
and TDAQ has implementation for it:
https://svnweb.cern.ch/trac/atlastdaq/browser/DAQ/DataFlow/histmon/trunk/src/THistRegisterImpl.cxx#L288 -
13:50
→
17:30
Hackathon - Cyclomatic Complexity 3h 40m 220
220
University of Glasgow
Speaker: Shaun Roe (CERN) -
15:30
→
16:00
Tea 30m 220 (Kelvin Building)
220
Kelvin Building
-
09:00
→
10:30
-
-
09:00
→
12:30
Hackathon - Algorithmic Migration 3h 30m 323
323
University of Glasgow
Speakers: Charles Leggett (Lawrence Berkeley National Lab. (US)), John Baines (STFC - Rutherford Appleton Lab. (GB)), Scott Snyder (Brookhaven National Laboratory (US)), Vakho Tsulaia (Lawrence Berkeley National Lab. (US))This session could include:
- CaloHive in athenaMT
- Extend ID experience to migrate first Muon algo(s)
- Implementation of Arrays of Handles / optional Handles
- Can we manage without UpdateHandle? How to deal with collections that are not relevant to scheduling
- Creation of IDC in views
Notes:
- Array of Handles: Agreed to add these (Charles)
- UpdateHandles: Alternatives found for use cases discussed
- Update common pattern in muons, simplest solution is copy.
- PixelAmbiguitiesMap (axample showed by Adam) not needed.
- Trigger use-case for offline data preparation: Add RegionSelectorSvc to InDet data preparation algorithms (trigger-specific configuration)
- Scheduler & decoration: Use case: algo1->A->algo2->A*->algo3 Need solution to ensure algo3 is scheduled only after decoration (A*). Need DecorateHandle that creates alias for decorated collection?
-
09:00
→
12:30
Hackathon - Digitisation 3h 30m 424
424
University of Glasgow
Speakers: John Derek Chapman (University of Cambridge (GB)), Zachary Louis Marshall (Lawrence Berkeley National Lab. (US)) -
09:00
→
12:30
Hackathon - Google Test 3h 30m 424
424
University of Glasgow
Speaker: Stefan Kluth (Max-Planck-Institut fuer Physik (Werner-Heisenberg-Institut) (D) -
10:30
→
11:00
Coffee 30m 323 (Kelvin Building)
323
Kelvin Building
-
12:30
→
13:30
Lunch 1h 323 (Kelvin Building)
323
Kelvin Building
-
13:30
→
17:30
Hackathon - ACTS 4h 423
423
University of Glasgow
Speakers: Andreas Salzburger (CERN), Christian Gumpert (CERN) -
13:30
→
17:30
Hackathon - Conditions 4h 323
323
University of Glasgow
Speakers: Charles Leggett (Lawrence Berkeley National Lab. (US)), Scott Snyder (Brookhaven National Laboratory (US)), Vakho Tsulaia (Lawrence Berkeley National Lab. (US)) -
13:30
→
17:30
Hackathon - Google Test 4h 423
423
University of Glasgow
Speaker: Stefan Kluth (Max-Planck-Institut fuer Physik (Werner-Heisenberg-Institut) (D) -
13:30
→
17:30
Hackathon - Trigger Demonstrator 4h 323
323
University of Glasgow
Speakers: John Baines (STFC - Rutherford Appleton Lab. (GB)), Simon George (Royal Holloway, University of London) -
15:30
→
16:00
Tea 30m 323 (Kelvin Building)
323
Kelvin Building
-
18:30
→
22:30
Dinner 4h The Bothy
The Bothy
11 Ruthven LaneHillhead Glasgow West End G12 9BG
-
09:00
→
12:30
-
-
09:00
→
12:00
Hackathon - Job Configuration 3h 423
423
University of Glasgow
Speaker: Walter Lampl (University of Arizona (US)) -
09:00
→
12:00
Hackathon - Trigger Demonstrator 3h 323
323
University of Glasgow
Speakers: John Baines (STFC - Rutherford Appleton Lab. (GB)), Simon George (Royal Holloway, University of London) -
09:00
→
12:00
Hackathon - git workflows 3h 323
323
University of Glasgow
Speakers: Edward Moyse (University of Massachusetts (US)), Elmar Ritsch (CERN), Emil Obreshkov (University of Texas at Arlington (US)), Frank Winklmeier (University of Oregon (US)), Goetz Gaycken (Universitaet Bonn (DE)), Graeme Stewart (University of Glasgow (GB)) -
10:30
→
11:00
Coffee 30m 323 (Kelvin Building)
323
Kelvin Building
-
12:00
→
12:30
Wrap Up Lecture Theatre 257
Lecture Theatre 257
University of Glasgow
Conveners: Graeme Stewart (University of Glasgow (GB)), Walter Lampl (University of Arizona (US))- 12:00
-
12:02
Hackathon - Google Test 2mSpeaker: Stefan Kluth (Max-Planck-Institut fuer Physik (Werner-Heisenberg-Institut) (D)
-
12:04
Hackathon - Digitisation 2mSpeaker: John Derek Chapman (University of Cambridge (GB))
-
12:06
Hackathon - git workflows 2mSpeaker: Edward Moyse (University of Massachusetts (US))
-
12:08
Hackathon - Algorithmic Migration 2mSpeaker: Charles Leggett (Lawrence Berkeley National Lab. (US))
-
12:10
Hackathon - Conditions 2mSpeaker: Charles Leggett (Lawrence Berkeley National Lab. (US))
- 12:12
-
12:14
Hackathon - Trigger Demonstrator 2mSpeaker: John Baines (STFC - Rutherford Appleton Lab. (GB))
-
12:16
Hackathon - Configuration 2mSpeaker: Walter Lampl (University of Arizona (US))
- 12:18
-
12:30
→
13:30
Lunch 1h 323 (Kelvin Building)
323
Kelvin Building
-
09:00
→
12:00