Oct 10 – 14, 2016
San Francisco Marriott Marquis
America/Los_Angeles timezone

Taking HEP data management outside of HEP

Oct 11, 2016, 12:00 PM
GG C3 (San Francisco Mariott Marquis)


San Francisco Mariott Marquis

Oral Track 4: Data Handling Track 4: Data Handling


Bo Jayatilaka (Fermi National Accelerator Lab. (US))


High Energy Physics experiments have long had to deal with huge amounts of data. Other fields of study are now being faced with comparable volumes of experimental data and have similar requirements to organize access by a distributed community of researchers. Fermilab is partnering with the Simons Foundation Autism Research Initiative (SFARI) to adapt Fermilab’s custom HEP data management system (SAM) to catalog genome data. SFARI has petabyte scale datasets stored in the Fermilab Active Archive Facility and needs to catalog the data, organizing it according to metadata for processing and analysis by a diverse community of researchers. The SAM system is used for data management by multiple HEP experiments at Fermilab and is flexible enough to provide the basis for handling other types of data. This presentation describes both the similarities and the differences in requirements and the challenges in adapting an existing system to a new field.

Secondary Keyword (Optional) Distributed data handling
Primary Keyword (Mandatory) Experience/plans from outside experimental HEP/NP

Primary author


Bo Jayatilaka (Fermi National Accelerator Lab. (US)) Ian Fisk (Fermi National Accelerator Lab. (US))

Presentation materials