Speaker
Frank Wuerthwein
(Univ. of California San Diego (US))
Description
CMS deployed a prototype infrastructure based on Elastic Search that stores all classAds from the global pool. This includes detailed information on IO, CPU, datasets, etc. etc. for all analysis as well as production jobs. We will present initial results from analyzing this wealth of data, describe lessons learned, and plans for the future to derive operational benefits from analyzing this data on a routine basis.
Primary Keyword (Mandatory) | Accounting and information |
---|---|
Secondary Keyword (Optional) | Data processing workflows and frameworks/pipelines |
Tertiary Keyword (Optional) | Monitoring |
Author
Frank Wuerthwein
(Univ. of California San Diego (US))
Co-authors
Mr
Aidan Macdonald
(UCSD)
Benjamin Stieger
(University of Nebraska (US))
Brian Paul Bockelman
(University of Nebraska (US))
Kenneth Bloom
(University of Nebraska (US))