Software Technical Meeting

9 Nov 2015, 09:00 → 13 Nov 2015, 18:00 US/Pacific

LBNL

This technical interchange meeting will look at the ongoing framework developments, what we should be doing in software infrastructure, how simulation, digitisation and reconstruction will evolve in the next few years towards Run3.

We intend for this meeting to be discussion-rich, rather the full of talks and also to have room for discussion of more radical solutions and possibly disruptive changes.

Note that in addition to the general plenary sessions (Mon-Wed) rooms are available for smaller dedicated breakouts and hackathons Thursday and Friday. Sessions are definitely planned for the Kaggle Tracking Challenge and for the new framework. All participants are encouraged to stay and further proposals are very welcome.

 

ffreq-report-draft2-1.pdf

LBL Guest House Booking Instructions

LBNL Bus Pass-Core software.pdf

Meeting Notebook

Travel Planner

Maps

• Building 23 (Guest House)
• Building 2 (Mon,Wed)
• Building 54 (Cafeteria)
• Building 70A (Tue, Thu)
• Great China Restaurant

Photos lbl-tim-507225.jpg

Monday, 9 November

09:00 → 09:15 Welcome and Introduction

Conveners: Graeme Stewart (University of Glasgow (GB)), Paolo Calafiura (Lawrence Berkeley National Lab. (US)), Zachary Louis Marshall (Lawrence Berkeley National Lab. (US))

09:00 Safety and Practical Matters

Speaker: Paolo Calafiura (Lawrence Berkeley National Lab. (US))

Welcome to LBL Nov 15.pdf

Welcome to LBL Nov 15.pptx

09:05 Introduction

Speaker: Graeme Stewart (University of Glasgow (GB))

intro.pdf

09:15 → 13:00 Core Software

• Progress with the framework
• Conditions access
• Trigger and event view status
• I/O layer
• Dependency declarations
• StoreGate
• ...
• General discussion on HLT/Offline synergy (beyond event views)?
• Databases
• Changes for Run3, multiple events in flight, making it all efficient, ...
• Geometry

Conveners: Charles Leggett (Lawrence Berkeley National Lab. (US)), John Baines (STFC - Rutherford Appleton Lab. (GB)), Scott Snyder (Brookhaven National Laboratory (US)), Vakho Tsulaia (Lawrence Berkeley National Lab. (US))

09:15 Conditions data access

Speakers: Andrea Formica (CEA/IRFU,Centre d'etude de Saclay Gif-sur-Yvette (FR)), Scott Snyder (Brookhaven National Laboratory (US)), Vakho Tsulaia (Lawrence Berkeley National Lab. (US))

2015-11-09-conditions.pdf

ConditionsAccessAthena.pdf

WhyANewConditionsDB.pdf

10:15 Coffee

10:30 Framework support for accelerators

Speaker: Sami Kama (Southern Methodist University (US))

Framework support for Accelerators.pdf

Framework support for Accelerators.pptx

11:00 Gaudi changes / StoreGate / *Handles

Speaker: Charles Leggett (Lawrence Berkeley National Lab. (US))

2015-11-09-sg.pdf

2015.11.09_TIM_Core.pdf

12:30 → 14:00 Lunch

14:00 → 18:00 Core Software

• Progress with the framework
• Conditions access
• Trigger and event view status
• I/O layer
• Dependency declarations
• StoreGate
• ...
• General discussion on HLT/Offline synergy (beyond event views)?
• Databases
• Changes for Run3, multiple events in flight, making it all efficient, ...
• Geometry

Conveners: Charles Leggett (Lawrence Berkeley National Lab. (US)), John Baines (STFC - Rutherford Appleton Lab. (GB)), Scott Snyder (Brookhaven National Laboratory (US)), Vakho Tsulaia (Lawrence Berkeley National Lab. (US))

14:00 Invited talk: Scientific data stores outside HEP

Speaker: Wahid Bhimji (Lawrence Berkeley National Lab. (US))

WB-ATLAS-SWTIM-Nov9.pdf

WB-ATLAS-SWTIM-Nov9.pptx

14:30 Event Views

Speakers: Benjamin Michael Wynne (University of Edinburgh (GB)), John Baines (STFC - Rutherford Appleton Lab. (GB))

EventViewSummary.pdf

15:00 Coffee

15:15 I/O

Speakers: David Malon (Argonne National Laboratory (US)), Jack Cranshaw (Argonne National Laboratory (US)), Peter Van Gemmeren (Argonne National Laboratory (US))

AthenaIOthreads.pdf

AthenaIOthreads.ppt

Berkeley_Metadata_Jack.pdf

Berkeley_Metadata_Jack.pptx

IOandStorage.pdf

IOandStorage.pptx

Malon2015November9IO.pdf

Malon2015November9IO.pptx

16:30 Event Service

Speakers: David Malon (Argonne National Laboratory (US)), Peter Van Gemmeren (Argonne National Laboratory (US)), Torre Wenaus (Brookhaven National Laboratory (US)), Vakho Tsulaia (Lawrence Berkeley National Lab. (US))

Intro slides

SharedReader.pdf

SharedReader.pptx

Tuesday, 10 November

09:00 → 12:30 Reconstruction

• What have we learned (so far) from the design review
• Thread safety in reco algorithms
• High pileup strategies: serial vs. parallel

Conveners: Andreas Salzburger (CERN), Edward Moyse (University of Massachusetts (US))

09:00 Invited Talk: Writing Xeon Phi optimised code

Speaker: Katie Antypas

Paolo_HEP_Nov_2015.pdf

Paolo_HEP_Nov_2015.pptx

10:00 Overview of Tracking software

Speaker: Andreas Salzburger (CERN)

MuonReconstruction.pdf

TIM2015-Nov-Salzburger.pdf

11:00 Coping with pileup

Speaker: Nicholas Styles

Berkeley.pdf

11:20 Discussion...

12:30 → 14:00 Lunch

14:00 → 17:30 Simulation

• Full Simulation
• Fast Simulation
• Digitisation

Conveners: Elmar Ritsch (CERN), Zachary Louis Marshall (Lawrence Berkeley National Lab. (US))

14:00 Meet the New Simulation Infrastructure

The simulation infrastructure that we hope will carry us through Run 3 and beyond

Speaker: Elmar Ritsch (CERN)

SimulationInfrastructure.pdf

14:30 Geant4: Where we are and where we are going

Speakers: Andrea Dotti (Università and INFN Pisa), Andrea Dotti (SLAC National Accelerator Laboratory (US)), Makoto Asai (SLAC), Makoto Asai (SLAC National Accelerator Laboratory (US))

Geant4 Status ATLAS TIM.pdf

15:00 Coffee

15:15 MT Simulation: can we get there from here?

Speakers: Steven Andrew Farrell (University of California-Unknown-Unknown), Steven Andrew Farrell (Lawrence Berkeley National Lab. (US))

Farrell_G4Hive_v3.pdf

16:15 Upgrade Considerations

Speaker: Jason Nielsen (University of California,Santa Cruz (US))

UpgradeSimulation_TSM_Nielsen_20151110.pdf

17:00 A couple of Other Random Thoughts

Speaker: Zachary Louis Marshall (Lawrence Berkeley National Lab. (US))

Marshall TIM 2015.11.10.pdf

Wednesday, 11 November

09:00 → 12:30 Analysis

• Making a start with the new framework
• Getting AthAnalysis working with Hive
• Making LCG releases easier on non-x86 machines (macs!)
• What is a dual use algorithm anyway...?
• Analysis workload scaling for run3 (and then run4)
• Future of analysis frameworks and tools (QuickANA, RootCore, ROOT7, ...)

Conveners: Attila Krasznahorkay (CERN), Nils Erik Krumnack (Iowa State University (US))

09:00 Introduction

Quick overview of current ATLAS analysis code usage. Mostly intended for non-ATLAS participants.

Speakers: Attila Krasznahorkay (CERN), Nils Erik Krumnack (Iowa State University (US))

TIM-15-11-11.pdf

09:20 The Future of ROOT

ROOT development plans towards ROOT 7. And how it may affect analysers.

Speaker: Philippe Canal (Fermi National Accelerator Lab. (US))

ROOT7-ATLAS-SoftwareWeek-2015-11-Philippe.key.pdf

10:20 Coffee/Tea Break

10:40 Migrating Analysis Frameworks to the Future Framework

Possibilities for migrating analysis frameworks, and in particular QuickAna to use the future framework.

Speaker: Steven Andrew Farrell (Lawrence Berkeley National Lab. (US))

Farrell_AnaFramworks_v1.pdf

11:40 (Analysis) Release Building and Distribution

Discussion on how to build and analysis releases in the future. How LCG releases could be used. How CMake and CPack could be used.

Speaker: Attila Krasznahorkay (CERN)

Release Building and Distribution 2015.11.11..pdf

12:30 → 14:00 Lunch

14:00 → 17:30 Infrastructure, Tools and Education

Conveners: Alexander Undrus (Brookhaven National Laboratory (US)), Emil Obreshkov (University of Innsbruck (AT)), Graeme Stewart (University of Glasgow (GB))

practical.pdf

14:00 Software Quality

Speakers: Scott Snyder (Brookhaven National Laboratory (US)), Stefan Kluth (Max-Planck-Institut fuer Physik (Werner-Heisenberg-Institut) (D), Stewart Martin-Haugh (STFC - Rutherford Appleton Lab. (GB))

15:30 Coffee

15:50 Version Control Systems

Speaker: Graeme Stewart (University of Glasgow (GB))

version-control.pdf

16:10 NICOS Evolution and Jenkins Evaluation

Speaker: Alexander Undrus (Brookhaven National Laboratory (US))

TIM_2015_UNDRUS_FINAL.pdf

TIM_2015_UNDRUS_FINAL.pptx

16:50 HSF Collaboration and Projects

Speaker: Benedikt Hegner (CERN)

HSF_111115.pdf

18:30 → 19:30 Social Dinner

Thursday, 12 November

09:00 → 18:00 Framework Hackaton

09:00 → 13:00 Tracking ML Challenge mini-workshop

09:00 Overview of track reconstruction

Speaker: Andreas Salzburger (CERN)

TIM2015-ML-Challenge-discussion.pdf

09:30 Simulation and data samples for Tracking Challenge

Speaker: Andreas Salzburger (CERN)

agenda

10:00 coffee break

10:30 Highlights from Data Science @ CERN workshop

Speakers: David Rousseau (LAL-Orsay, FR), Tobias Golling (Universite de Geneve (CH))

11:00 A webml track visualizer, and other support tools

Speaker: Edward Moyse (University of Massachusetts (US))

Geometry JSON

Link to demo

Reconstruction JSON

11:30 Nailing the question, and the metric

Speaker: Isabelle Guyon

12:00 Next Steps - Discussion

Friday, 13 November

09:00 → 18:00 Framework Hackaton