Sep 2 – 9, 2007
Victoria, Canada
Europe/Zurich timezone
Please book accomodation as soon as possible.

Management System of Event Processing and Data Files Based on XML Software Tools at Belle

Sep 3, 2007, 8:00 AM
10h 10m
Victoria, Canada

Victoria, Canada

Board: 45
poster Software components, tools and databases Poster 1

Speaker

Dr Ichiro Adachi (KEK)

Description

The Belle experiment has been operational since 1999 and we have processed more than 700/fb of data so far. To cope with ever increasing data, complete automation of the event processing is one of the most critical issues. In addition, unified management in the processing job and the processed data files to be analyzed is very important especially to deal with ~400K data files amounting to Peta-scale data. To do this, we have implemented new application called “R&D Chain Management (RCM)”. In the RCM program, we define a “work- flow” as a set of check-points related to the event processing procedures such as job submission, job log verification, output file backup and so on. The work-flow is described in the XML and it is so flexible that we can cover all of actions required in the processing stream. The RCM application automatically surveys each check- point in the work-flow and it reports failure if any. Furthermore, simultaneously the RCM tools can store any necessary information at each check-point into the own database written in the XML. The RCM system provides the web-based interface between the XML database and users for an excellent visualization. Thus, one can quickly pick up relevant information from this system. The processed data files are also taken care by this RCM, and automatic action to take a backup, for instance, can be issued from the RCM tools. We will present our experience using the RCM software tool as well as performance in the Belle data management.

Primary author

Co-authors

Mr Masahiko Yokoyama (KEK) Prof. Nobuhiko Katayama (KEK) Mr Takashi Okamoto (Quatre-i science cooporation) Mr Yukimasa Matsuda (Quatre-i science cooporation) Dr Yutaka Ueshima (Quatre-i science cooporation)

Presentation materials