10–14 Oct 2016
San Francisco Marriott Marquis
America/Los_Angeles timezone

CMS Software Performance Measurements "in the wild"

11 Oct 2016, 15:30
1h 15m
San Francisco Marriott Marquis

San Francisco Marriott Marquis

Poster Track 7: Middleware, Monitoring and Accounting Posters A / Break

Speaker

Frank Wuerthwein (Univ. of California San Diego (US))

Description

CMS deployed a prototype infrastructure based on Elastic Search that stores all classAds from the global pool. This includes detailed information on IO, CPU, datasets, etc. etc. for all analysis as well as production jobs. We will present initial results from analyzing this wealth of data, describe lessons learned, and plans for the future to derive operational benefits from analyzing this data on a routine basis.

Primary Keyword (Mandatory) Accounting and information
Secondary Keyword (Optional) Data processing workflows and frameworks/pipelines
Tertiary Keyword (Optional) Monitoring

Author

Frank Wuerthwein (Univ. of California San Diego (US))

Co-authors

Mr Aidan Macdonald (UCSD) Benjamin Stieger (University of Nebraska (US)) Brian Paul Bockelman (University of Nebraska (US)) Kenneth Bloom (University of Nebraska (US))

Presentation materials