Oct 10 – 14, 2016
San Francisco Marriott Marquis
America/Los_Angeles timezone

Expanding the user base beyond HEP for the Ganga distributed analysis user interface

Oct 13, 2016, 12:15 PM
15m
GG C2 (San Francisco Mariott Marquis)

GG C2

San Francisco Mariott Marquis

Oral Track 3: Distributed Computing Track 3: Distributed Computing

Speaker

Dr Robert Andrew Currie (Imperial College Sci., Tech. & Med. (GB))

Description

This talk will present the result of recent developments to support new users from the Large Scale Survey Telescope (LSST) group on the GridPP DIRAC instance. I will describe a workflow used for galaxy shape identification analyses whilst highlighting specific challenges as well as the solutions currently being explored. The result of this work allows this community to make best use of available computing resources.

The LSST workflow is CPU limited, producing a large amount of highly distributed output which is managed and collected in an automated way for the user. We have made use of the Ganga distributed analysis user interface to manage physics-driven workflows with large numbers of user generated jobs.

I will also present the successes of working with a new user community to take advantage of HEP related computing resources as this community migrates to make use of a more distributed computing environment.

Secondary Keyword (Optional) Outreach
Primary Keyword (Mandatory) Experience/plans from outside experimental HEP/NP
Tertiary Keyword (Optional) Preservation of analysis and data

Primary authors

Dr Robert Andrew Currie (Imperial College Sci., Tech. & Med. (GB)) Ulrik Egede (Imperial College Sci., Tech. & Med. (GB))

Co-authors

Alexander John Richards (Imperial College Sci., Tech. & Med. (GB)) Mark Slater (Birmingham University) Dr Matt Williams (University of Birmingham (GB))

Presentation materials