Speaker
Description
Luigi is a powerful workflow tool for data analyses. Yet, it has some limitations that become quite debilitating in larger and more complex workflows. The PyHEP.dev 2024 Talk waluigi - Beyond luigi outlined some basic principles and ideas that sought to address these shortcomings. Together with the feedback gathered from the community an implementation is now available:
ParaO is the name of a new python package, and it's central building block, the parametrized object. Dependencies upon each other are expressed as parameters of corresponding type, thus relying on composition instead of inheritance. Beyond this, the means by which specific parameters can be set are vastly expanded, which enable effective use of large and deep graphs. These parameter mechanics also allow the transplantation and stitching together of different graphs at runtime.
While the package is still quite young, the majority of the features is already implemented, thus allowing serious use already. This contribution introduced the core principles behind ParaO and contextualizes some of them with Luigi. A live demonstration shows a broad scope of features from how to get started up to some more advanced patterns.
