We upgraded Indico to version 3.0. The new search is now available as well.
10-15 March 2019
Steinmatte conference center
Europe/Zurich timezone

In-Memory Parallel Computing for Partial Wave Analysis

Not scheduled
20m
Steinmatte conference center

Steinmatte conference center

Hotel Allalin, Saas Fee, Switzerland https://allalin.ch/conference/
Poster Track 1: Computing Technology for Physics Research Poster Session

Speaker

Mr Zhanchen Wei (IHEP, CAS)

Description

The traditional partial wave analysis (PWA) algorithm is designed to process data serially which requires a large amount of memory that may exceed the memory capacity of one single node to store runtime data. It is quite necessary to parallelize this algorithm in a distributed data computing framework to improve its performance. Within an existing production-level Hadoop cluster, we implement PWA algorithm on the basis of Spark to process data storing on low-level storage system HDFS. But in this case, sharing data through HDFS or internal data communication mechanism of Spark is extremely inefficient. In order to solve this problem, this paper presents an in-memory parallel computing method for PWA algorithm. With this system, we can easily sharing runtime data in parallel algorithms. We can ensure complete data locality to keep compatibility with the traditional data input/output way and cache most repeated used data in memory to improve the performance, owe to the data management mechanism of Alluxio.

Primary author

Mr Zhanchen Wei (IHEP, CAS)

Co-authors

Dr Qiulan Huang (IHEP, CAS) Gongxing Sun (INSTITUE OF HIGH ENERGY PHYSICS) Ms Xiaoyu Liu (IHEP, CAS)

Presentation materials

There are no materials yet.

Peer reviewing

Paper