27 September 2004 to 1 October 2004
Interlaken, Switzerland
Europe/Zurich timezone

Paths: Specifying Multiple Job Outputs via Filter Expressions

30 Sept 2004, 10:00
1h
Coffee (Interlaken, Switzerland)

Coffee

Interlaken, Switzerland

Board: 24
poster Track 3 - Core Software Poster Session 3

Speaker

C. Jones (CORNELL UNIVERSITY)

Description

A common task for a reconstruction/analysis system is to be able to output different sets of events to different permanent data stores (e.g. files). This allows multiple related logical jobs to be grouped into one process and run using the same input data (read from a permanent data store and/or created from an algorithm). In our system, physicists can specify multiple output 'paths', where each path contains a group of filters followed by output 'operations'. The filters are combined using a physicist specified boolean expression; only if the expression evaluates to true will the output operation be performed for that event. Paths do not explicitly contain the order that data objects should be created as our system uses a 'data on demand' mechanism which causes data to be created the first time the data is requested. Separating the data dependencies from the event selection criteria vastly simplifies the task of creating a path, thereby making the facility more accessible to physicists.

Primary author

C. Jones (CORNELL UNIVERSITY)

Presentation materials