EDM4hep Discussion

Tuesday 30 Jul 2024, 09:00 → 10:00 Europe/Zurich

Zoom

Live Notes

EDM4hep Live Notes
==================

Date: July 30, 2024
Indico: https://indico.cern.ch/event/1442316/

Connected: Andre, Juraj, Leonhard, Tao, Swathi, Brieuc, Juan, Thomas

Apologies: Frank

## Introduction and General Points

* Migrated Live Notes to CodiMD

### Upcoming workshops / conferences
https://github.com/orgs/key4hep/projects/4/views/1
    
## Progress and discussion
    
## Podio
* https://github.com/AIDASoft/podio/pulls
* https://github.com/AIDASoft/podio/issues
* https://github.com/orgs/AIDASoft/projects/2/views/1

### Merged PRs
* Make subset collection JSON dumping not duplicate information
    * https://github.com/AIDASoft/podio/pull/640
* Document I/O interfaces
    * https://github.com/AIDASoft/podio/pull/648
* Add test files for compatibility with v01-00 and fix buggy v00-99 file
    * https://github.com/AIDASoft/podio/pull/643
* Include / header cleanups
    * https://github.com/AIDASoft/podio/pull/645
    * https://github.com/AIDASoft/podio/pull/641

### RDataSource for podio
* https://github.com/AIDASoft/podio/pull/593
* Possible to have a generice `RDataSource` for all generated EDMs
* Some comments to be addressed

### Templated links between arbitrary datatypes
* https://github.com/AIDASoft/podio/pull/257
* `Association` -> `Link` after EDM4hep discussion

### Make collection iterators fulfill `LegacyInputIterator` and `input_iterator` concept (wip)
* https://github.com/AIDASoft/podio/pull/626
* Documentation + usability upgrade for algorithms

### `podio-dump` implementation in c++ (wip)
* https://github.com/AIDASoft/podio/pull/620
* Complaints here: https://github.com/key4hep/EDM4hep/issues/312
* ~10 times faster than python implementation
* Needs `fmt`-lib for formatting (or gcc > 13 / clang > 16)
* dumping of datamodels stored in files not easy to implement in c++
     - Would require to implement an in-memory conversion from JSON to YAML
     - Keep that functionality in python in new tool
        
### Frame serialization / deserialization
* https://github.com/AIDASoft/podio/issues/565
* Not part of v1.0
* Proposal from D. Lawrence: https://github.com/AIDASoft/podio/pull/579

### Leak in SIO Frame reading
* https://github.com/AIDASoft/podio/issues/594

## EDM4hep
* https://github.com/key4hep/EDM4hep/pulls
* https://github.com/key4hep/EDM4hep/issues
* https://github.com/orgs/key4hep/projects/5 

### Merged PRs
* Remove the dQ/dx related information from the Track
    * https://github.com/key4hep/EDM4hep/pull/311
* Overhaul the relations between Vertex and ReconstructedParticle
    * https://github.com/key4hep/EDM4hep/pull/332
* Add python script to generate EDM4hep file using the complete datamodel
    * https://github.com/key4hep/EDM4hep/pull/272
     
### Handling of links / associations
* See also discussion for naming in https://github.com/key4hep/EDM4hep/issues/344
* Changes in https://github.com/key4hep/EDM4hep/pull/341
    * ExtraCode to keep (almost) transparent for downstream
        * k4SimGeant4 has some forward declarations that need fixing
    * Current implementation is very similar to what templated links do
        * Possible to transparently "schema evolve" this
* PR in podio for templated links https://github.com/AIDASoft/podio/pull/257
* [ ] Fix downstream breakage with PRs
* [ ] Merge
* [ ] Let one nightly build pass and make pre-release tag

## Converter & MarlinWrapper

* Several PRs to keep nightly builds running in converter, MarlinWrapper and FWCore, see links in EDM4hep PRs
    
## AoB

* Make a release with EDM4hep pre-release tag

## Next meeting:
* Aug 13, 09:00

09:00 → 09:05 Introduction

Speakers: Andre Sailer (CERN), Frank-Dieter Gaede (Deutsches Elektronen-Synchrotron (DE)), Thomas Madlener (Deutsches Elektronen-Synchrotron (DESY))

EDM4hep Github

Podio Github

09:50 → 09:51 Discussion

Speaker: Dr All