5–10 Jun 2016
Padova, Italy
Europe/Rome timezone

TaskRouter: A newly desinged online data processing framework

7 Jun 2016, 15:00
1h 30m
Centro Congressi (Padova)

Centro Congressi

Padova

Poster presentation Processing Farms Poster session 1

Speaker

Mr Minhao Gu (IHEP)

Description

TaskRouter is a runtime software and framework for distributed computing. It can be used to facilitate the development of online processing system for High Energy Physics experiments. The framework takes the responsibility of data transmission. Users can determine how data being processed and routed on each node by implementing a single callback interface. One or more backup slaves can be configured for critical nodes in TaskRouter system, and single point failures such as sudden node power off can automatically recover without data loss. TaskRouter is flexible, easy to use and high available. This paper presents the core design of the framework and some performance test results with a dummy online processing procedure.

Primary authors

Mr Fei Li (IHEP) Mr Kejun Zhu (IHEP) Mr Minhao Gu (IHEP) Mr Wei Shen (IHEP)

Presentation materials