Oct 10 – 14, 2016
San Francisco Marriott Marquis
America/Los_Angeles timezone

Production Management System for AMS Remote Computing Centers

Oct 13, 2016, 3:30 PM
1h 15m
San Francisco Marriott Marquis

San Francisco Marriott Marquis

Poster Track 7: Middleware, Monitoring and Accounting Posters B / Break


Baosong Shan (Beihang University (CN))


The Alpha Magnetic Spectrometer (AMS) on board of the International Space Station (ISS) requires a large amount of computing power for data production and Monte Carlo simulation. A large fraction of the computing resource has been contributed by the computing centers among the AMS collaboration. AMS has 12 “remote” computing centers outside of Science Operation Center at CERN, with different hardware and software configurations.

This paper presents a production management system for remote computing sites, to automate the processes including job acquiring, submitting, monitoring, transferring and accounting. The system is designed to be modularized, light-weighted, and easy-to-be-deployed. It is based on Deterministic Finite Automaton, and implemented by script languages, Python and Perl, and the built-in Sqlite3 database on Linux operating systems. Different batch management systems (LSF, PBS, Condor ...), file system storage (GPFS, Lustre, EOS ...), and transferring protocols (GRIDFTP, XROOTD ...) are supported. In addition, the recent experience of the integration of the system with Open Science Grid is also described.

Primary Keyword (Mandatory) Data processing workflows and frameworks/pipelines

Primary author

Baosong Shan (Beihang University (CN))


Alexander Egorov (Massachusetts Inst. of Technology (US)) Alexandre Eline (Massachusetts Inst. of Technology (US)) Oleg Demakov (Massachusetts Inst. of Technology (US)) Renli Shi (Southeast University (CN)) Vitaly Choutko (Massachusetts Inst. of Technology (US))

Presentation materials