Analysis Description Languages for the LHC

America/Chicago
Sunrise (WH11NE) (Fermilab, Wilson Hall)

Sunrise (WH11NE)

Fermilab, Wilson Hall

Kirk and Wilson Roads, Batavia IL, 60510
Steve Mrenna (Fermi National Accelerator Lab. (US)), Jim Pivarski (Princeton University), Harry Prosper (Florida State University (US)), Sezen Sekmen (Kyungpook National University (KR)), Gokhan Unel (University of California Irvine (US))
Description

This meeting aims to introduce and discuss framework-independent analysis description language concepts and implementations for LHC physics analyses. An analysis description language (ADL) is a human readable format capable of describing the contents of an analysis in a standard and unambiguous way, independent of any computing framework. Adapting ADLs would have numerous benefits for the LHC community, ranging from analysis preservation that goes beyond the lifetimes of experiments or analysis software, to facilitating the abstraction, design, visualization, validation, combination, reproduction, interpretation and overall communication of the contents of LHC analyses. ADLs can be used both by the experimental and phenomenological communities. Several attempts were made recently to develop ADLs and generic interpreters for those. A recent effort is in progress to merge the existing approaches and bring forward a unified ADL syntax. 

The meeting will motivate the ADL concept, present the current proposal, and have technical discussions on language structure, parsing and interpretation methods.  Hands on sessions will focus on studying and running existing analysis implementations, and on implementing new analyses proposed by the participants.  A special discussion will be held on the feasibility of ADLs for direct use in analyses with ATLAS and CMS data.

The workshop is open to all interested experimentalists, phenomenologists and computing specialists.

We would really appreciate if you could fill the following participants feedback form whether you attended this workshop live or offline, it will help us improve the LPC events offering:

https://forms.gle/nACR7mVCCqwh8RCo6

You are welcome to join the following gitter forum where ADL discussions will continue:

https://gitter.im/HSF/ADL

Chairs:

Steve Mrenna (Fermilab)
Jim Pivarski (Princeton U.)
Harrison Prosper (Florida State U.)
Sezen Sekmen (Kyungpook National U.)
Gökhan Ünel (UC Irvine)

Local Organizing Committee:
Gabriele Benelli (Brown U.)
Alexx Perloff (U. Colorado, Boulder)
Marc Weinberg (Carnegie Mellon U.)

LPC Events Committee Chairs:
Gabriele Benelli (Brown U.)
Ben Kreis (Fermilab)
Kevin Pedro (Fermilab)

LPC Coordinators: 
Cecilia Gerber (UIC)
Sergo Jindariani (Fermilab)

Participants
  • Abdollah Mohammadi
  • Alexx Perloff
  • Ana Trisovic
  • Andrea Rizzi
  • Benjamin Krikler
  • Bo Jayatilaka
  • Candan Dozen
  • David Yu
  • Davide Valsecchi
  • Fatma Boran
  • Gabriele Benelli
  • Gordon Watts
  • Gökhan ÜNEL
  • Harry Prosper
  • Henry Fredrick Schreiner
  • Jake Rosenzweig
  • James Kowalkowski
  • Javier Mauricio Duarte
  • Jieun Yoo
  • Jim Pivarski
  • Joel Walker
  • Joshua Isaacson
  • Judita Mamuzic
  • Lindsey Gray
  • Lothar A.T. Bauerdick
  • Marc Paterno
  • Marguerite Belt Tonjes
  • Maria Acosta Flechas
  • Mark Neubauer
  • Miaoyuan Liu
  • Nicholas Manganelli
  • Nick Smith
  • Philippe Gras
  • Ramanpreet Singh
  • Saba Sehrish
  • Sezen Sekmen
  • Stephan Lammel
  • Steve Mrenna
  • Thomas Junk
  • Tommaso Boccali
  • Tyler Mitchell
  • Ufuk Guney Tok
  • Zhenbin Wu
  • Zoltan Gecse
    • 1
      Introduction to analysis description languages Sunrise (WH11NE)

      Sunrise (WH11NE)

      Fermilab, Wilson Hall

      Kirk and Wilson Roads, Batavia IL, 60510
      Speaker: Sezen Sekmen (Kyungpook National University (KR))
    • 2
      ADL and the transpiler adl2tnm Sunrise (WH11NE)

      Sunrise (WH11NE)

      Fermilab, Wilson Hall

      Kirk and Wilson Roads, Batavia IL, 60510
      Speaker: Harry Prosper (Florida State University (US))
    • 3
      CutLang: analysis description language and runtime interpreter Sunrise (WH11NE)

      Sunrise (WH11NE)

      Fermilab, Wilson Hall

      Kirk and Wilson Roads, Batavia IL, 60510
      Speaker: Gokhan Unel (University of California Irvine (US))
    • 10:30
      Coffee break Sunrise (WH11NE)

      Sunrise (WH11NE)

      Fermilab, Wilson Hall

      Kirk and Wilson Roads, Batavia IL, 60510
    • 4
      ADL/CutLang: hands-on demo Sunrise (WH11NE)

      Sunrise (WH11NE)

      Fermilab, Wilson Hall

      Kirk and Wilson Roads, Batavia IL, 60510
      Speakers: Gokhan Unel (University of California Irvine (US)), Harry Prosper (Florida State University (US)), Sezen Sekmen (Kyungpook National University (KR))
    • 12:00
      Lunch Sunrise (WH11NE)

      Sunrise (WH11NE)

      Fermilab, Wilson Hall

      Kirk and Wilson Roads, Batavia IL, 60510
    • 5
      ADL/CutLang: hands-on demo (continued) Sunrise (WH11NE)

      Sunrise (WH11NE)

      Fermilab, Wilson Hall

      Kirk and Wilson Roads, Batavia IL, 60510
      Speakers: Gokhan Unel (University of California Irvine (US)), Harry Prosper (Florida State University (US)), Sezen Sekmen (Kyungpook National University (KR))
    • 6
      lhada2rivet Sunrise (WH11NE)

      Sunrise (WH11NE)

      Fermilab, Wilson Hall

      Kirk and Wilson Roads, Batavia IL, 60510
      Speaker: Philippe Gras (Université Paris-Saclay (FR))
    • 15:00
      Coffee break Sunrise (WH11NE)

      Sunrise (WH11NE)

      Fermilab, Wilson Hall

      Kirk and Wilson Roads, Batavia IL, 60510
    • 7
      How to build your own language: hands-on demo Sunrise (WH11NE)

      Sunrise (WH11NE)

      Fermilab, Wilson Hall

      Kirk and Wilson Roads, Batavia IL, 60510
      Speaker: Jim Pivarski (Princeton University)
    • 8
      LINQ Sunrise (WH11NE)

      Sunrise (WH11NE)

      Fermilab, Wilson Hall

      Kirk and Wilson Roads, Batavia IL, 60510
      Speaker: Gordon Watts (University of Washington (US))
    • 9
      YAML as an ADL Sunrise (WH11NE)

      Sunrise (WH11NE)

      Fermilab, Wilson Hall

      Kirk and Wilson Roads, Batavia IL, 60510
      Speaker: Benjamin Krikler (University of Bristol (GB))
    • 10
      NAIL: A prototype analysis language on top of RDataFrame Sunrise (WH11NE)

      Sunrise (WH11NE)

      Fermilab, Wilson Hall

      Kirk and Wilson Roads, Batavia IL, 60510
      Speaker: Andrea Rizzi (INFN Sezione di Pisa, Universita' e Scuola Normale Superiore, P)
    • 10:30
      Coffee break Sunrise (WH11NE)

      Sunrise (WH11NE)

      Fermilab, Wilson Hall

      Kirk and Wilson Roads, Batavia IL, 60510
    • 11
      TTreeFormula Sunrise (WH11NE)

      Sunrise (WH11NE)

      Fermilab, Wilson Hall

      Kirk and Wilson Roads, Batavia IL, 60510
      Speaker: Philippe Canal (Fermi National Accelerator Lab. (US))
    • 12
      AEACUS and RHADAMANTUS Sunrise (WH11NE)

      Sunrise (WH11NE)

      Fermilab, Wilson Hall

      Kirk and Wilson Roads, Batavia IL, 60510
      Speaker: Joel Walker (Sam Houston State University)
    • 12:30
      Lunch Sunrise (WH11NE)

      Sunrise (WH11NE)

      Fermilab, Wilson Hall

      Kirk and Wilson Roads, Batavia IL, 60510
    • 13
      Discussion: where/for what do we need a domain-specific language? Sunrise (WH11NE)

      Sunrise (WH11NE)

      Fermilab, Wilson Hall

      Kirk and Wilson Roads, Batavia IL, 60510
      • What different purposes can ADLs serve?
      • One or multiple ADLs?
      • The scope of ADLs? selecting events? filling histograms? fitting?
      • How would ADLs improve our way of thinking about our analyses?
      • ...
      Speaker: Harry Prosper (Florida State University (US))
    • 14
      Discussion: what physics-specific content should be included? Sunrise (WH11NE)

      Sunrise (WH11NE)

      Fermilab, Wilson Hall

      Kirk and Wilson Roads, Batavia IL, 60510
      • Which elements of object and event operations can be described in an ADL? Where do we stop?
      • What logical / mathematical operations do we use?
      • How far do we go in describing composite objects, object groups, event variables?
      • ...
      Speaker: Sezen Sekmen (Kyungpook National University (KR))
    • 15:40
      Workshop picture WH11XO

      WH11XO

      Fermilab, Wilson Hall

    • 15:45
      Coffee break Sunrise (WH11NE)

      Sunrise (WH11NE)

      Fermilab, Wilson Hall

      Kirk and Wilson Roads, Batavia IL, 60510
    • 15
      ADLs for analysis combination Sunrise (WH11NE)

      Sunrise (WH11NE)

      Fermilab, Wilson Hall

      Kirk and Wilson Roads, Batavia IL, 60510
      Speaker: Nadja Strobbe (Fermi National Accelerator Lab. (US))
    • 16
      Discussion: what are the language users' requirements? Sunrise (WH11NE)

      Sunrise (WH11NE)

      Fermilab, Wilson Hall

      Kirk and Wilson Roads, Batavia IL, 60510
      • How to go from an ADL to performing a full fledged experimental analysis?
      • How much do the current interpreters meet the analysts' needs? What is missing?
      • Can we provide generic tools to parse ADLs in experimental analysis frameworks?
      • How can we use ADLs for combination of analyses?
      • ...
      Speaker: Alexx Perloff (University of Colorado Boulder (US))
    • 19:00
      Workshop dinner at Indian Harvest, Naperville Sunrise (WH11NE)

      Sunrise (WH11NE)

      Fermilab, Wilson Hall

      Kirk and Wilson Roads, Batavia IL, 60510
    • 17
      Discussion: what kind of language/syntax do we need? Sunrise (WH11NE)

      Sunrise (WH11NE)

      Fermilab, Wilson Hall

      Kirk and Wilson Roads, Batavia IL, 60510
      • Most generic and economic ways to cover the widest collection of needs from the biggest variety of analyses?
      • Objects, composite objects, event variables, definitions, selections, event weighting, …
      • Intrinsic loops, reducers, optimizers, object combinations/permutations/partitioning, ternary operations, …
      • Expressing the event input
      • Expressing external functions
      • ...
      Speaker: Jim Pivarski (Princeton University)
    • 10:20
      Coffee break Sunrise (WH11NE)

      Sunrise (WH11NE)

      Fermilab, Wilson Hall

      Kirk and Wilson Roads, Batavia IL, 60510
    • 18
      Discussion: what tooling (parser/interpreter/compiler) do we need? Sunrise (WH11NE)

      Sunrise (WH11NE)

      Fermilab, Wilson Hall

      Kirk and Wilson Roads, Batavia IL, 60510
      • Interpreters? Transpilers? Which method for which purpose?
      • How to create the most flexible tools for most generic usage?
        Issues of speed, user-friendliness?
      • How to automate incorporation of event input formats? How to deal with different event formats? Common extensible object(s)?
      • How to automate incorporation of external functions?
      • Histogramming, event weighting?
      • ...
      Speaker: Jim Pivarski (Princeton University)
    • 12:00
      Lunch Sunrise (WH11NE)

      Sunrise (WH11NE)

      Fermilab, Wilson Hall

      Kirk and Wilson Roads, Batavia IL, 60510
    • 19
      Discussion: ADLs for analysis preservation Sunrise (WH11NE)

      Sunrise (WH11NE)

      Fermilab, Wilson Hall

      Kirk and Wilson Roads, Batavia IL, 60510
      • What are the central LHC analysis preservation tools?
      • How can ADLs help analysis preservation? How can they be incorporated into the system?
      • Databases for event input formats, standard object definitions, event variables, external functions… ?
      • ...
      Speakers: Pamfilos Fokianos (CERN), Sunje Dallmeier-Tiessen (Humboldt-Universitaet zu Berlin (DE)), Tibor Simko (CERN)
    • 14:20
      Coffee break Sunrise (WH11NE)

      Sunrise (WH11NE)

      Fermilab, Wilson Hall

      Kirk and Wilson Roads, Batavia IL, 60510
    • 20
      Discussion: Feedback from other experiments Sunrise (WH11NE)

      Sunrise (WH11NE)

      Fermilab, Wilson Hall

      Kirk and Wilson Roads, Batavia IL, 60510
      • What do physics analyses consist of in other experiments?
      • Would ADLs for other experiments be built on similar concepts as in ATLAS/CMS?
      • What can ATLAS/CMS learn from the other experiments?
      • ...
      Speaker: Tom Junk (Fermi National Accelerator Lab. (US))
    • 21
      Summary / How to move forward Sunrise (WH11NE)

      Sunrise (WH11NE)

      Fermilab, Wilson Hall

      Kirk and Wilson Roads, Batavia IL, 60510

      Summarizing the next steps and planning how to proceed.

      Speakers: Alexx Perloff (University of Colorado Boulder (US)), Gokhan Unel (University of California Irvine (US)), Harry Prosper (Florida State University (US)), Jim Pivarski (Princeton University), Sezen Sekmen (Kyungpook National University (KR)), Stephen Mrenna (FERMILAB)
    • 22
      Fermilab colloquium : Particle physics and programming languages Wilson Hall (Fermilab)

      Wilson Hall

      Fermilab

      Programming languages aren't for computers; they're for people. If a language doesn't make it easier to express your physics problem, it's not a suitable language. Some fields have specialized "Domain Specific Languages" (DSLs) that trade freedom of expression for focus on the problem at hand, and can even improve performance by limiting this scope. A prime example is SQL, widely used by data analysts outside of physics, which trades generic computation for a SELECT-WHERE-GROUPBY pattern. Interestingly, this was the design pattern of the first electromechanical computers (Hollerith machine, 1890) and it's still a major focus of big data today (Dean & Ghemawat: MapReduce, 2004). Particle physics problems don't fit SQL well; in fact, physicists became involved in computing in tandem with the invention of generic, digital computers (Von Neumann's stored-program machine, 1945). I will present some history, some general features of programming languages, what "declarative" really means, and will show some perhaps surprising examples of DSLs you're already using.

      Speaker: Jim Pivarski (Princeton University)