Speaker
Alexander Egorov
(Massachusetts Inst. of Technology (US))
Description
The AMS data production uses different programming modules for job submission, execution and management, as well as for validation of produced data. The modules communicate with each other using CORBA interface. The main module is the AMS production server, a scalable distributed service which links all modules together starting from job submission request and ending with writing data to disk storage. Each running instance of the server has the capacity to manage around 1000 multithreaded jobs capable to serve up to 64K CPUs. Monitoring and management tools with enhanced GUI are also described.
| Primary Keyword (Mandatory) | Data processing workflows and frameworks/pipelines |
|---|
Authors
Alexander Egorov
(Massachusetts Inst. of Technology (US))
Vitaly Choutko
(Massachusetts Inst. of Technology (US))
Co-authors
Alexandre Eline
(Massachusetts Inst. of Technology (US))
Baosong Shan
(Beihang University (CN))
Oleg Demakov
(Massachusetts Inst. of Technology (US))
Renli Shi
(Southeast University (CN))
